-- Logs begin at Fri 2022-07-15 14:48:47 UTC, end at Fri 2022-07-15 16:20:25 UTC. -- Jul 15 15:44:04.678367 dv-cinder-835878-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 15:44:04.688059 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 15:44:04 2022] *** Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: nodename: dv-cinder-835878-3-iscsi Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: machine: x86_64 Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: clock source: unix Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: pcre jit disabled Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: detected number of CPU cores: 4 Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: current working directory: / Jul 15 15:44:04.690019 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: detected binary path: /usr/bin/uwsgi-core Jul 15 15:44:04.690662 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: your processes number limit is 47680 Jul 15 15:44:04.690662 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: your memory page size is 4096 bytes Jul 15 15:44:04.690662 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: detected max file descriptor number: 2048 Jul 15 15:44:04.690662 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: lock engine: pthread robust mutexes Jul 15 15:44:04.690662 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: thunder lock: enabled Jul 15 15:44:04.690662 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 15:44:04.690662 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 15:44:04.729397 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: Python main interpreter initialized at 0x563e271f89c0 Jul 15 15:44:04.729397 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: python threads support enabled Jul 15 15:44:04.729397 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: your server socket listen backlog is limited to 100 connections Jul 15 15:44:04.729397 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: your mercy for graceful operations on workers is 90 seconds Jul 15 15:44:04.729716 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 15:44:04.729813 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: *** Operational MODE: preforking *** Jul 15 15:44:04.730055 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: *** uWSGI is running in multiple interpreter mode *** Jul 15 15:44:04.730055 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: spawned uWSGI master process (pid: 115560) Jul 15 15:44:04.730233 dv-cinder-835878-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 15:44:04.731287 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: spawned uWSGI worker 1 (pid: 115561, cores: 1) Jul 15 15:44:04.731287 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: spawned uWSGI worker 2 (pid: 115562, cores: 1) Jul 15 15:44:04.731287 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 15:44:05.389895 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 15:44:05.390498 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 15:44:06.488542 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:44:06.488542 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: from cryptography.utils import int_from_bytes Jul 15 15:44:06.489207 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:44:06.489207 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: from cryptography.utils import int_from_bytes Jul 15 15:44:06.491184 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:44:06.491184 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: from cryptography.utils import int_from_bytes Jul 15 15:44:06.491646 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:44:06.491646 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: from cryptography.utils import int_from_bytes Jul 15 15:44:08.962590 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:44:08.963256 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:44:08.963384 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:44:08.963741 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:44:08.963998 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:44:08.964390 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.964718 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.964810 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:44:08.965158 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:44:08.965249 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.965340 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.965504 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:44:08.965689 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.965899 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:44:08.966000 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.966157 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:44:08.966312 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.966545 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.966638 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.966876 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.966969 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.967192 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.967319 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.967532 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.967638 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.967860 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-3-iscsi {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.967954 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.968173 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.968258 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.968479 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.968573 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.968787 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.968882 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.969104 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.969196 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.969367 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.969459 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.969684 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.969795 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.970013 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-3-iscsi {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.970120 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.970338 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.970501 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.971742 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.971902 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.972031 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.972165 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.972305 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.972465 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.972599 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.972729 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.972869 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.972988 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.973116 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.973246 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.973383 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.973528 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.973661 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.973781 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.973911 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.974043 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.974178 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.974307 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.974455 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.974599 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-3-iscsi {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.974734 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.974868 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.974991 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.975120 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.975240 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.975393 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.975526 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.975638 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.975761 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.975889 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.976010 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.976142 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.976267 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-3-iscsi {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.976397 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.976538 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.976674 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.976805 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.976939 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.977069 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.977391 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.977534 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.977666 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.977781 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.977903 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.978043 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.978168 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.978339 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.978468 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.978668 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.978806 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.978982 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.979117 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.979336 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.979485 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.979616 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.979748 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.979920 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.980066 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.980233 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.980368 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.980520 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.980658 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.980782 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.980905 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.981083 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.981213 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.981922 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.982138 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.982272 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.982405 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.982529 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.982719 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.982857 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.982981 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.983103 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.983267 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.983429 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.983620 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.983757 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.983948 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.984088 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.984261 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.984393 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.984526 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.984659 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.984792 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.984916 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.985047 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.985176 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.985371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.985507 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.985685 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.985814 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.985997 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.986131 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.986308 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.986443 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.986619 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.986747 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.986929 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.987056 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.987432 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.987589 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.987731 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.987858 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.987988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.988124 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.988249 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.988371 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.988505 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.988629 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.988795 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.988938 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.989107 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.989235 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.989430 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.989558 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.989752 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.989886 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.990060 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.990195 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.990369 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.990515 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.990688 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.990827 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.991013 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.991150 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.991335 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.991465 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.991606 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.991731 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.991879 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.992009 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.992185 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.992327 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.992505 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.992640 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.992812 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.992940 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.993117 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.993254 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.993426 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.993565 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.993728 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.993863 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.994036 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.994165 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.994350 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.994486 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.994653 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.994780 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.994960 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.995095 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.995268 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.995426 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.995595 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.995722 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.995902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.996036 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.996204 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.996338 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.996509 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.996636 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.996815 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.997001 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.997851 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.997982 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.998112 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.998238 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.998369 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.998504 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.998635 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.998768 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.998900 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.999025 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.999177 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.999340 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.999509 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.999637 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.999815 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:08.999951 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.000140 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.000281 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.000449 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.000577 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.000755 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.000890 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.001074 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.001212 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.001384 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.001526 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.001691 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.001820 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.002003 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.002141 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.002305 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.002431 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.002612 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.002748 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.002922 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.003063 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.003228 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.003396 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.003560 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.003701 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.003865 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.004002 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.004172 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.004302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.004475 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.004611 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.004781 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.004920 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.005083 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.005211 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.005387 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.005521 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.005687 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.005815 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.005992 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.006118 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.006298 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.006432 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.006603 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.006732 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.006907 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.007034 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.007211 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.007388 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.007542 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.007669 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.007942 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.008076 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.008210 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.008348 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.008481 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.008612 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.008760 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.008895 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.009070 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.009275 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.009403 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.009537 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.009662 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.009792 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.009978 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:44:09.010115 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.010317 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.010476 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.010652 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.010779 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.010972 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.011099 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.011283 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.011447 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.011626 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.011755 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.011944 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.012083 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.012262 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.012399 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.012612 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.012740 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.012929 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.013064 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.013247 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.013384 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.013560 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.013713 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.013858 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.013982 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.014178 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.014307 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.014505 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.014634 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.014825 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.014959 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.015127 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.015254 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.015490 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.015619 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.015838 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.015969 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.016153 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.016282 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.016477 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.016618 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.016801 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.016930 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.017114 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.017244 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.017426 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.017564 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.017738 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.018011 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.018147 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.018275 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.018407 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.018545 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.018671 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.018796 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.018992 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.019122 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.019319 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.019470 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.019638 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.019767 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.019951 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.020079 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.020265 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.020395 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.020578 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.020706 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.020916 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.021052 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.021233 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.021371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.021549 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.021677 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.021864 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.021992 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.022182 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.022312 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.022495 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.022633 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.022807 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.022943 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.023119 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.023248 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.023450 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.023580 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.023757 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.023898 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.024068 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.024196 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.024379 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.024500 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.024682 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.024818 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.025000 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.025129 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.025323 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.025455 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.025628 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.025762 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.025933 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.026059 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.026243 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.026377 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.026552 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.026688 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.026862 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.026987 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.027170 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.027346 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.027488 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.027622 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.027802 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.028174 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.028315 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.028468 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.028606 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.028811 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.028941 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.029126 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.029254 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.029440 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.029624 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.029753 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.029875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.030056 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.030193 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.030361 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.030497 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.030676 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.030815 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.030989 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.031116 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.031322 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.031464 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.031633 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.031768 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.031950 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.032103 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.032308 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.032449 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.032575 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.032742 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.032886 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.033057 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.033215 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.033372 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.033521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.033694 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.033841 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.034012 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.034149 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.034330 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.034458 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.034651 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.034778 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.034972 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.035099 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.035284 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.035468 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.035629 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.035764 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.035948 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.036077 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.036270 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.036404 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.036581 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.036709 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.036886 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.037027 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.037192 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.037326 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.037497 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.037632 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.037801 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.037930 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.038207 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.038356 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.038482 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.038615 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.038740 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.038864 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.038997 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.039134 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.039311 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.039456 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.039622 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.039751 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.039966 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.040095 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.040273 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.040415 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.040617 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.040745 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.040953 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.041094 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.041275 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.041412 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.041598 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.041726 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.041913 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.042039 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.042224 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.042353 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.042533 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.042666 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.042841 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.042969 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.043152 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.043287 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.043490 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.043618 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.044386 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.044528 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.044666 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.044793 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.044949 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.045077 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.045260 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.045388 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.045584 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.045726 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.045896 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.046025 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.046218 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.046346 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.046525 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.046655 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.046840 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.046974 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.047157 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.047317 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.047515 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.047644 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.047834 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.047961 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.048154 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.048433 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.048562 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.048693 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.048825 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.048955 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.049082 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.049214 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.049362 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.049497 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.049673 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.049802 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.049985 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.050122 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.050303 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.050444 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.050615 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.050756 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.050935 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.051065 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.051244 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.051414 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.051575 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.051712 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.051889 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.052026 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.052209 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.052334 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.052763 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.052884 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.053079 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.053207 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.053393 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.053518 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.053717 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.053846 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.054027 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.054161 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.054347 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.054474 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.054663 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.054790 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.054973 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.055100 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.055284 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.055443 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.055621 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.055758 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.055927 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.056061 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.056230 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.056372 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.056541 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.056678 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.056856 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.056983 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.057168 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.057296 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.057480 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.057619 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.057787 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.057915 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.058101 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.058229 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.058489 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.058634 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.058767 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.058892 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.059015 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.059139 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.059276 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.059481 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.060158 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.060288 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.060475 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.060603 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.060799 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.060929 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.061124 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.061254 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.061431 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.061559 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.061738 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.061866 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.062062 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.062199 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.062374 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.062502 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.062702 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.062830 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.062974 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.063109 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.063278 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.063431 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.063627 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.063753 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.063943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.064069 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.064255 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.064392 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.064562 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.066531 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.066687 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.066819 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.066819 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.067069 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.067195 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.067373 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.067634 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.067793 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.067793 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068181 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068181 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068181 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068181 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068801 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068927 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068927 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068927 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.068927 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.069375 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.069505 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.069505 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.069505 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.069842 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.069962 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.070082 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.070210 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.070332 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.070641 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.070956 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.071555 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.071905 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.072249 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.072599 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.072932 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.073263 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.073592 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.073914 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.074239 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.074571 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.075183 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.075549 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.075877 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.076318 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.076443 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.076652 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.076804 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.076981 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.077162 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.077323 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.077509 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.077659 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.077853 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.078011 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.078187 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.078326 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.078526 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.078791 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.078927 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.079050 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.079244 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.079585 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.079725 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.079898 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.080022 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.080214 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.080339 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.080528 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.080655 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.080848 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.080973 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.081160 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.081286 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.081474 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.081607 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.081784 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.081916 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.082094 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.082225 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.082416 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.082558 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.082729 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.082854 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.083046 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.083164 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.083381 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.083655 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.083786 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.083916 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.084046 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.084175 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.084319 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.084459 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.084632 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.084757 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.084945 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.085070 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.085297 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.085432 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.085611 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.085734 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.085928 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.086061 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.086244 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.086372 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.086570 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.086696 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.086886 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.087011 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.087200 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.087358 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.087543 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.087667 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.087859 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.087983 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.088170 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.088305 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.088480 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.088606 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.088872 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.089000 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.089132 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.089254 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.089375 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.089495 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.089695 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.089831 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.090008 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.090134 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.090319 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.090480 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.090648 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.090782 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.090961 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.091086 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.091275 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.091414 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.091609 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.091811 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.091935 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.092064 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.092228 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.092362 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.092536 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.092672 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.092906 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.093032 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.093222 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.093354 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.093537 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.093674 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.093847 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.093979 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.094162 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.094288 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.094469 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.094594 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.094790 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.094915 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.095096 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.095221 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.095432 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.095560 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.095743 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.095870 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.096058 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.096183 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.096371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.096495 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.096676 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.096800 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.096987 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.097125 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.097304 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.097428 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.097612 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.097737 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.097920 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.098052 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.098232 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.098355 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.098569 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.098707 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.098966 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.099104 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.099227 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.099381 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.099515 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.099637 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.099765 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.099896 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.100072 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.100204 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.100386 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.100515 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.100692 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.100816 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.101000 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.101124 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.101311 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.101439 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.101619 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.101742 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.101923 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.102046 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.102230 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.102355 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.102536 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.102660 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.102843 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.102966 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.103151 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.103277 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.103502 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.103635 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.103814 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.103945 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.104120 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.104254 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.104428 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.104559 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.104736 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.104859 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.105048 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.105181 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.105359 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.105483 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.105672 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.105795 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.105979 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.106112 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.106798 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.106929 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.107109 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.107233 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.107473 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.107607 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.107781 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.107903 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.108102 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.108232 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.108409 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.108543 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.108716 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.108837 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.109092 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.109220 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.109356 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.109480 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.109625 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.109748 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.109932 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.110058 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.110257 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.110422 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.110555 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.110734 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.110865 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.111056 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.111193 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.111406 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.111527 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.111725 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.111850 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.112044 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.112178 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.112362 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.112486 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.112670 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.112802 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.112990 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.113115 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.113306 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.113430 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.113615 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.113739 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.113921 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.114045 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.114229 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.114353 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.114541 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.114664 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.114856 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.114981 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.115167 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.115307 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.115501 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.115625 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.115816 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.115943 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.116129 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.116254 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.116436 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.116571 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.116754 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.116886 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.117063 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.117186 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.117369 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.117503 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.117680 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.117803 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.117986 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.118116 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.118298 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.118431 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.118602 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.118726 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.118916 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.119173 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.119362 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.119501 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.119624 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.119744 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.119865 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.119986 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.120162 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.120296 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.120477 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.120603 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.120788 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.120912 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.121117 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.121241 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.121420 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.121545 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.121729 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.121854 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.122748 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.122888 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.123020 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.123142 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.123333 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.123462 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.123646 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.123773 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.123954 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.124079 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.124268 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.124402 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.124597 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.124723 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.124905 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.125039 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.125213 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.125347 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.125520 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.125646 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.125846 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.125971 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.126154 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.126289 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.126477 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.126602 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.126902 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.127027 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.127221 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.127391 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.127559 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.127683 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.127875 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.127998 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.128187 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.128313 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.128496 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.128620 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.128811 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.128935 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.129273 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.129420 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.129543 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.129665 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.129786 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.129905 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.130035 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.130157 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.130351 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.130485 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.130662 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.130786 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.130989 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.131122 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.131357 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.131547 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.131717 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.131855 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.132033 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.132176 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.132379 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.132505 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.132675 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.132800 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.132994 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.133127 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.133321 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.133457 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.133680 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.133802 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.134011 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.134143 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.134322 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.134446 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.134642 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.134765 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.134954 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.135092 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.135276 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.135427 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.135607 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.135732 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.135925 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.136060 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.136235 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.136367 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.136541 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.136663 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.136865 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.136990 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.137174 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.137297 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.137489 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.137639 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.137841 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.137966 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.138156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.138281 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.138466 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.138590 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.138775 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.138901 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.139102 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.139226 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.139490 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.139618 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.139752 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.139884 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.140060 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.140192 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.140387 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.140522 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.140711 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.140839 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.141020 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.141143 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.141346 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.141516 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.141641 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.141763 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.141951 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.142078 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.142260 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.142399 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.142570 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.142696 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.142917 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.143044 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.143225 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.143384 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.143572 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.143706 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.143891 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.144015 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.144218 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.144350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.144530 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.144653 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.144855 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.144978 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.145181 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.145307 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.145492 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.145617 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.145809 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.145932 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.146121 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.146246 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.146431 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.146561 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.146737 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.146862 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.147044 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.147168 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.147370 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.147507 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.147686 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.147820 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.147994 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.148127 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.148305 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.148430 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.148610 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.148744 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.148917 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.149042 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.149223 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.149348 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.149609 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.149745 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.149875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.149997 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.150155 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.150288 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.150466 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.150604 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.150773 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.150907 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.151081 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.151207 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.151415 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.151544 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.151727 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.151850 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.152038 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.152162 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.152345 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.152473 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.152656 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.152781 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.152963 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.153087 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.153841 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.154008 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.154215 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.154341 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.154551 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.154685 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.154876 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.155038 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.155194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.155343 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.155555 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.155699 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.155858 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.156008 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.156181 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.156306 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.156502 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.156637 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.156822 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.156948 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.157134 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.157259 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.157453 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.157586 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.157772 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.157898 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.158097 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.158222 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.158539 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.158672 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.158856 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.158981 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.159188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.159352 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.159661 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.159799 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.159928 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.160049 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.160169 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.160288 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.160479 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.160604 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.160791 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.160915 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.161110 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.161234 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.161425 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.161556 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.161736 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.161867 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.162057 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.162255 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.162380 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.162500 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.162687 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.162818 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.163028 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.163216 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.163359 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.163583 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.163708 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.163904 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.164025 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.164221 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.164347 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.164538 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.164663 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.164857 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.164989 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.165176 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.165300 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.165493 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.165617 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.165811 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.165948 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.166127 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.166259 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.166439 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.166561 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.166755 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.166888 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.167072 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.167197 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.167411 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.167533 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.167727 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.167859 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.168043 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.168169 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.168357 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.168481 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.168674 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.168839 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.169538 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.169799 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.169937 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.170060 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.170193 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.170317 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.170508 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.170634 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.170824 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.170961 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.171141 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.171271 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.171489 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.171695 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.171821 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.172015 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.172134 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.172353 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.172479 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.172685 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.172824 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.173015 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.173141 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.173335 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.173461 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.173656 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.173789 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.173986 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.174103 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.174298 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.174423 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.174607 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.174741 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.174922 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.175054 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.175234 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.175412 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.175568 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.175711 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.175897 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.176030 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.176212 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.176445 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.176580 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.176767 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.176892 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.177111 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.177235 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.177697 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.177921 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.178048 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.178279 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.178404 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.178603 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.178729 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.178936 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.179069 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.179261 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.179418 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.179599 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.179726 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.179990 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.180114 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.180242 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.180363 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.180490 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.180620 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.180818 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.180942 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.181132 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.181265 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.181441 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.181573 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.181748 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.181880 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.182057 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.182183 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.182374 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.182596 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.182722 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.182955 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.183080 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.183281 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.183445 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.183613 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.183739 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.183944 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.184071 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.184255 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.184405 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.184595 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.184720 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.184928 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.185061 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.185243 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.185381 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.185556 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.185681 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.185880 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.186013 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.186197 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.186331 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.186507 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.186633 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.186817 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.186941 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.187123 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.187259 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.187462 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.187599 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.187771 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.187895 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.188083 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.188209 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.188389 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.188514 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.188698 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.188823 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.189045 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.189180 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.189371 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.189496 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.189680 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.189806 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.190068 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.190197 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.190319 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.190440 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.190587 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.190712 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.190909 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.191044 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.191216 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.191358 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.191554 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.191690 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.191865 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.191988 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.192180 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.192306 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.192490 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.192738 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.192866 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.193077 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.193202 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.193398 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.193522 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.193733 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.193858 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.194069 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.194193 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.194378 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.194509 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.194684 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.194809 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.194990 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.195113 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.195337 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.195477 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.195640 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.195772 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.195953 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.196078 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.196265 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.196409 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.196576 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.196706 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.196890 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.197016 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.197201 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.197458 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.197585 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.197797 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.197923 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.198113 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.198249 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.198423 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.198549 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.198734 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.198859 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.199046 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.199179 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.199388 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.199576 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.199705 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.199838 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.200123 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.200269 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.200394 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.200515 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.200637 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.200759 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.200941 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.201067 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.201255 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.201379 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.201570 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.201695 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.201882 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.202014 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.202191 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.202316 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.202499 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.202631 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.202809 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.202933 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.203121 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.203246 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.203459 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.203598 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.203766 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.203892 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.204321 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.204512 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.204644 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.204860 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.204994 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.205184 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.205307 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.205500 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.205634 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.205820 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.205953 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.206143 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.206268 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.206459 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.206592 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.206771 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.206904 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.207084 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.207216 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.207421 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.207555 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.207743 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.207868 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.208077 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.208203 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.208397 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.208522 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.208707 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.208831 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.209013 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.209139 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.209322 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.209456 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.209635 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.209761 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.209954 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.210088 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.210348 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.210471 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.210592 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.210721 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.210850 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.210986 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.211147 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.211274 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.211508 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.211643 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.211765 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.211919 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.212052 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.212253 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.212378 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.212647 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.212788 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.212933 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.213065 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.213239 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.213365 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.213542 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.213680 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.213847 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.213979 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.214151 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.214276 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.214456 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.214589 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.214767 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.214892 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.215075 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.215201 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.215405 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.215543 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.216219 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.216345 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.216529 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.216654 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.216835 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.216959 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.217143 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.217268 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.217456 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.217595 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.217763 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.217895 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.218074 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.218199 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.218379 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.218505 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.218686 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.218812 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.218990 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.219109 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.219397 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.219526 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.219729 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.219854 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.220044 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.220169 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.220421 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.220591 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.220725 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.220846 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.220967 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.221087 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.221237 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.221379 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.221544 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.221677 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.221850 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.221975 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.222160 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.222359 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.222490 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.222613 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.222791 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.222918 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.223122 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.223260 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.223454 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.223588 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.223780 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.223910 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.224097 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.224230 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.224414 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.224545 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.224734 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.224860 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.225050 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.225182 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.225360 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.225484 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.225681 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.225811 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.225994 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.226120 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.226306 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.226436 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.226617 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.226749 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.226928 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.227058 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.227244 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.227405 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.227583 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.227724 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.227898 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.228024 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.228221 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.228346 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.228528 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.228664 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.228854 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.228979 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.229174 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.229297 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.229484 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.229609 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.229801 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.229932 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.230115 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.230240 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.230504 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.230634 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.230757 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.230878 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.231048 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.231175 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.231908 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.232041 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.232234 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.232361 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.232551 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.232685 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.232872 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.233004 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.233126 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:44:09.233247 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.233487 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.233808 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.234128 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.234459 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.234790 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.235226 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.235586 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.235920 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.236276 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.236594 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.236943 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.237281 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.237599 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.237914 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.238225 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:44:09.238471 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:44:09.296806 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO dbcounter [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Registered counter for database nova_api Jul 15 15:44:09.301130 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO dbcounter [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Registered counter for database nova_api Jul 15 15:44:09.411900 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG oslo_db.sqlalchemy.engines [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:44:09.415273 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_db.sqlalchemy.engines [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:44:09.418415 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writer thread running {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:44:09.422283 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writer thread running {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:44:09.478468 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.context [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7af00cbd-57c5-414c-96c9-6111e9479151(cell1) {{(pid=115562) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 15:44:09.478664 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.context [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7af00cbd-57c5-414c-96c9-6111e9479151(cell1) {{(pid=115561) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 15:44:09.482425 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:09.482531 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG oslo_concurrency.lockutils [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:09.484528 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG oslo_concurrency.lockutils [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:09.484630 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:09.485342 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG oslo_concurrency.lockutils [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:09.485434 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:09.487478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG oslo_concurrency.lockutils [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:09.487624 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:09.489421 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO dbcounter [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Registered counter for database nova_cell0 Jul 15 15:44:09.489583 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO dbcounter [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Registered counter for database nova_cell0 Jul 15 15:44:09.493248 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO dbcounter [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Registered counter for database nova_cell1 Jul 15 15:44:09.493530 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO dbcounter [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Registered counter for database nova_cell1 Jul 15 15:44:09.500653 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_db.sqlalchemy.engines [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:44:09.502286 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_db.sqlalchemy.engines [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:44:09.504581 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG oslo_db.sqlalchemy.engines [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:44:09.506260 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG oslo_db.sqlalchemy.engines [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:44:09.507798 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writer thread running {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:44:09.511857 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writer thread running {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:44:09.513361 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writer thread running {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:44:09.514999 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writer thread running {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:44:09.659693 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO dbcounter [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Registered counter for database nova_cell0 Jul 15 15:44:09.666578 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO dbcounter [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Registered counter for database nova_cell0 Jul 15 15:44:09.668440 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_db.sqlalchemy.engines [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:44:09.672786 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writer thread running {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:44:09.675203 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG oslo_db.sqlalchemy.engines [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:44:09.679722 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writer thread running {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:44:10.137598 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: WARNING keystonemiddleware.auth_token [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:44:10.144834 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: WARNING keystonemiddleware.auth_token [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:44:10.291640 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: WARNING keystonemiddleware.auth_token [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:44:10.299030 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: WARNING keystonemiddleware.auth_token [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:44:10.487178 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: WARNING keystonemiddleware.auth_token [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:44:10.493211 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: WARNING keystonemiddleware.auth_token [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:44:10.498670 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563e271f89c0 pid: 115562 (default app) Jul 15 15:44:10.500945 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:10.502183 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] 10.222.0.98 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001909 Jul 15 15:44:10.502596 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 1/1] 10.222.0.98 () {50 vars in 788 bytes} [Fri Jul 15 15:44:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:10.644597 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: WARNING keystonemiddleware.auth_token [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:44:10.650654 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: WARNING keystonemiddleware.auth_token [None req-d79d7c0d-8dce-4d17-9779-53482ee00cbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:44:10.656427 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563e271f89c0 pid: 115561 (default app) Jul 15 15:45:30.206637 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:30.207653 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 15 15:45:30.208318 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 2/2] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:30.220175 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writing DB stats nova_api:SELECT=3 {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:30.221462 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writing DB stats nova_cell0:SELECT=3 {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:30.222323 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writing DB stats nova_cell1:SELECT=3 {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:30.223360 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:31.075160 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-9f62e1f8-37c2-4c2d-a6f3-d3127cbea62d admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:31.105339 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-9f62e1f8-37c2-4c2d-a6f3-d3127cbea62d admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.890617 Jul 15 15:45:31.106080 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 1/3] 10.222.0.98 () {60 vars in 1291 bytes} [Fri Jul 15 15:45:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:33.334468 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:33.335513 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-d458a69b-01e2-4c9b-9beb-478586cd0102 None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jul 15 15:45:33.335908 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 3/4] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:33.814220 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-3ce393bf-3fed-400d-a545-4ae25b4f6fc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:33.832224 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:45:33.832224 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: warnings.warn(msg) Jul 15 15:45:33.909650 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-3ce393bf-3fed-400d-a545-4ae25b4f6fc4 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.567428 Jul 15 15:45:33.910404 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 2/5] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:45:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:45:33.925068 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_api:SELECT=3 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:33.926470 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_cell1:SELECT=3 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:33.927416 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_cell0:SELECT=3 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:33.928260 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:34.135200 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-f423d0af-1066-442d-bceb-46472ce079ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:34.137823 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:45:34.137823 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: warnings.warn(msg) Jul 15 15:45:34.264869 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-f423d0af-1066-442d-bceb-46472ce079ce admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.346112 Jul 15 15:45:34.280390 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 4/6] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Jul 15 15:45:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:36.554600 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-3ce393bf-3fed-400d-a545-4ae25b4f6fc4 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:36.555577 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-3ce393bf-3fed-400d-a545-4ae25b4f6fc4 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 15 15:45:36.555978 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 3/7] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:37.209422 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-dc57e7a4-a6d9-4fdf-89e6-b0628ccc04fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "disk": 5}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:37.227769 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:45:37.227769 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: warnings.warn(msg) Jul 15 15:45:37.349304 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-dc57e7a4-a6d9-4fdf-89e6-b0628ccc04fd admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.786848 Jul 15 15:45:37.356788 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 5/8] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:45:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:45:37.362935 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-9147de16-1757-4643-aecf-b457dea20899 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:37.364748 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:45:37.364748 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: warnings.warn(msg) Jul 15 15:45:37.487982 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-9147de16-1757-4643-aecf-b457dea20899 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129185 Jul 15 15:45:37.488509 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 4/9] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Jul 15 15:45:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:39.756837 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-dc57e7a4-a6d9-4fdf-89e6-b0628ccc04fd admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:39.757880 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-dc57e7a4-a6d9-4fdf-89e6-b0628ccc04fd admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 15 15:45:39.758282 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 6/10] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:45:40.158004 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-0c4aad30-99ab-494f-a4b6-8eebc4b5410a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G"}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:40.254142 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-0c4aad30-99ab-494f-a4b6-8eebc4b5410a admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489985 Jul 15 15:45:40.254860 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 5/11] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:45:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:45:40.267096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-78d3c070-5466-44c6-90c8-2798d34a9011 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:40.349382 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-78d3c070-5466-44c6-90c8-2798d34a9011 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086492 Jul 15 15:45:40.349957 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 7/12] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Jul 15 15:45:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:42.591247 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-0c4aad30-99ab-494f-a4b6-8eebc4b5410a admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:42.592385 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-0c4aad30-99ab-494f-a4b6-8eebc4b5410a admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 15 15:45:42.592779 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 6/13] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:43.072096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-6639c1fa-2b57-49cb-9079-0c64a2680241 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "d3"}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:43.158653 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-6639c1fa-2b57-49cb-9079-0c64a2680241 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.559753 Jul 15 15:45:43.159496 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 8/14] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:45:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:45:43.172099 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-337a1df1-f783-41e1-86a9-344c95e25998 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:43.259803 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-337a1df1-f783-41e1-86a9-344c95e25998 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091915 Jul 15 15:45:43.260563 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 7/15] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Jul 15 15:45:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:45.486570 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-6639c1fa-2b57-49cb-9079-0c64a2680241 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:45.487674 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-6639c1fa-2b57-49cb-9079-0c64a2680241 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 15 15:45:45.488066 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 9/16] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:45.951317 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-efe24b44-886d-4f15-8b09-b650bed81e17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "id": "d4"}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:46.025685 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-efe24b44-886d-4f15-8b09-b650bed81e17 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531588 Jul 15 15:45:46.026340 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 8/17] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:45:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:45:46.039038 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-9bed4928-6843-4ddd-84ae-79cbce5a36c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:46.166307 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-9bed4928-6843-4ddd-84ae-79cbce5a36c3 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130968 Jul 15 15:45:46.166885 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 10/18] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Jul 15 15:45:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:45:48.868516 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-efe24b44-886d-4f15-8b09-b650bed81e17 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:48.869896 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-efe24b44-886d-4f15-8b09-b650bed81e17 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Jul 15 15:45:48.870453 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 9/19] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:49.321280 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-458cd213-366f-4400-a0b2-77c5281d6260 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:49.350267 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-458cd213-366f-4400-a0b2-77c5281d6260 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.473347 Jul 15 15:45:49.350769 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 11/20] 10.222.0.98 () {60 vars in 1291 bytes} [Fri Jul 15 15:45:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:45:51.707693 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-efe24b44-886d-4f15-8b09-b650bed81e17 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:51.708701 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-efe24b44-886d-4f15-8b09-b650bed81e17 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 15 15:45:51.709106 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 10/21] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:52.162705 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-7b2cf067-2c30-400a-9481-0e4a4ee10642 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "disk": 1}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:52.279509 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-7b2cf067-2c30-400a-9481-0e4a4ee10642 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.564366 Jul 15 15:45:52.279931 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 12/22] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:45:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:45:52.291886 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-403bd793-4b68-421d-84ce-985d37633fbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:52.402772 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-403bd793-4b68-421d-84ce-985d37633fbb admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114475 Jul 15 15:45:52.403373 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 11/23] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Jul 15 15:45:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:45:54.594582 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-7b2cf067-2c30-400a-9481-0e4a4ee10642 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:54.595631 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-7b2cf067-2c30-400a-9481-0e4a4ee10642 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 15 15:45:54.596031 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 13/24] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:55.026945 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-83554e05-3894-4562-88f0-1db78202e28d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:55.113738 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-83554e05-3894-4562-88f0-1db78202e28d admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.511883 Jul 15 15:45:55.114307 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 12/25] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:45:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:45:55.126647 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-bc9520d0-a25a-4866-b846-ebc02d9be4fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:55.225115 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-bc9520d0-a25a-4866-b846-ebc02d9be4fb admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102394 Jul 15 15:45:55.225692 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 14/26] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Jul 15 15:45:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:57.450330 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-83554e05-3894-4562-88f0-1db78202e28d admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:57.451370 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-83554e05-3894-4562-88f0-1db78202e28d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 15 15:45:57.451814 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 13/27] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:57.950909 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-3374111b-027f-4eb1-83cd-5124a81b194c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:58.033950 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-3374111b-027f-4eb1-83cd-5124a81b194c admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.572322 Jul 15 15:45:58.034609 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 15/28] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:45:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:45:58.048150 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-042c892e-ebf6-421d-9942-7482c20dc089 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:58.129733 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-042c892e-ebf6-421d-9942-7482c20dc089 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085610 Jul 15 15:45:58.130662 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 14/29] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Jul 15 15:45:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:00.439962 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-3374111b-027f-4eb1-83cd-5124a81b194c admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:00.443904 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-3374111b-027f-4eb1-83cd-5124a81b194c admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Jul 15 15:46:00.443904 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 16/30] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:00.869022 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-9ce1c6b9-8e23-4e82-b63e-22c1993a9b22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:00.876693 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:00.948475 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-9ce1c6b9-8e23-4e82-b63e-22c1993a9b22 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500355 Jul 15 15:46:00.949025 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 15/31] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:46:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:46:00.962331 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-f587df0e-924c-46ff-a749-7bc10f002de7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:01.094313 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-f587df0e-924c-46ff-a749-7bc10f002de7 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136043 Jul 15 15:46:01.095489 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 17/32] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Jul 15 15:46:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:46:03.356613 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-9ce1c6b9-8e23-4e82-b63e-22c1993a9b22 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:03.357660 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-9ce1c6b9-8e23-4e82-b63e-22c1993a9b22 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 15 15:46:03.358250 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 16/33] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:46:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:03.803133 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-585dd5a8-35e5-4f59-ab15-4ab6dcd3b3ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:03.879217 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-585dd5a8-35e5-4f59-ab15-4ab6dcd3b3ef admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.514916 Jul 15 15:46:03.880144 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 18/34] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Jul 15 15:46:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:46:03.893992 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-2984ed58-ebe8-4c6f-9311-42ecf42a1fb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:04.015415 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-2984ed58-ebe8-4c6f-9311-42ecf42a1fb4 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114387 Jul 15 15:46:04.015415 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 17/35] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Jul 15 15:46:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:25.102319 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-585dd5a8-35e5-4f59-ab15-4ab6dcd3b3ef admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:25.103340 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-585dd5a8-35e5-4f59-ab15-4ab6dcd3b3ef admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 15 15:46:25.103735 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 19/36] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:46:25.500162 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-083e2efb-a63b-48d0-925c-1eea06311002 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:25.517016 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-083e2efb-a63b-48d0-925c-1eea06311002 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406815 Jul 15 15:46:25.517476 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 18/37] 10.222.0.98 () {60 vars in 1291 bytes} [Fri Jul 15 15:46:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:46:26.584980 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-585dd5a8-35e5-4f59-ab15-4ab6dcd3b3ef admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:26.585974 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-585dd5a8-35e5-4f59-ab15-4ab6dcd3b3ef admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 15 15:46:26.586372 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 20/38] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:46:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:27.107032 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-c692ac85-8f4f-4137-9e28-affa72be9315 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:27.113231 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.wsgi [None req-c692ac85-8f4f-4137-9e28-affa72be9315 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-c692ac85-8f4f-4137-9e28-affa72be9315 admin admin] Request method failure captured: Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Accept: application/json Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Accept-Encoding: gzip, deflate Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Connection: keep-alive Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Content-Length: 0 Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Host: 10.222.0.98 Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Openstack-Api-Version: compute 2.90 Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Openstack-System-Scope: None Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: User-Agent: python-novaclient Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Auth-Token: gAAAAABi0YvSI_48SZl56o1fSjf2ZrBvmkIOsgqk5ag6hWL6lVJP2pflZLlO6w4oZpCxwxRujJ42TvCUENRjJudNLPgz17fc6puApBrfOjc2Ru--AntxndgfYTouJ-dcTxoFTnrsrvLPdLYK93FQv_YN8jz2xIWIlME4d4q6xPO9g8qpDB-XSVc Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Domain-Id: None Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Domain-Name: None Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Identity-Status: Confirmed Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Is-Admin-Project: True Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Domain-Id: default Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Domain-Name: Default Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Name: admin Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Role: member,reader,admin Jul 15 15:46:27.116478 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Roles: member,reader,admin Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant: admin Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant-Name: admin Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User: admin Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Domain-Id: default Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Domain-Name: Default Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Id: fb07001f45bb40c8b8c84b7d67d1c304 Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Name: admin Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: method: > Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: exception: Flavor 42 could not be found. Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: action_args: {'id': '42'} Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:46:27.118144 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:27.119156 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.120521 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-c692ac85-8f4f-4137-9e28-affa72be9315 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:46:27.121854 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-c692ac85-8f4f-4137-9e28-affa72be9315 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394789 Jul 15 15:46:27.121854 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 19/39] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Jul 15 15:46:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:46:27.128091 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-b464d27b-5dd2-46a3-b076-e67c9a890d23 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:27.131226 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:27.149672 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-b464d27b-5dd2-46a3-b076-e67c9a890d23 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025691 Jul 15 15:46:27.150213 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 21/40] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Jul 15 15:46:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:46:27.160483 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-fa6cdce4-cc3a-4c5d-a18b-ee0e41b62c82 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:27.182674 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-fa6cdce4-cc3a-4c5d-a18b-ee0e41b62c82 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025848 Jul 15 15:46:27.183198 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 20/41] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Jul 15 15:46:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:46:27.192916 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-7192b6fb-42c9-4362-9587-98edef81e466 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:27.198496 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.wsgi [None req-7192b6fb-42c9-4362-9587-98edef81e466 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-7192b6fb-42c9-4362-9587-98edef81e466 admin admin] Request method failure captured: Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Accept: application/json Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Accept-Encoding: gzip, deflate Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Connection: keep-alive Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Content-Length: 0 Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Host: 10.222.0.98 Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Openstack-Api-Version: compute 2.90 Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Openstack-System-Scope: None Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: User-Agent: python-novaclient Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Auth-Token: gAAAAABi0YvSI_48SZl56o1fSjf2ZrBvmkIOsgqk5ag6hWL6lVJP2pflZLlO6w4oZpCxwxRujJ42TvCUENRjJudNLPgz17fc6puApBrfOjc2Ru--AntxndgfYTouJ-dcTxoFTnrsrvLPdLYK93FQv_YN8jz2xIWIlME4d4q6xPO9g8qpDB-XSVc Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Domain-Id: None Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Domain-Name: None Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Identity-Status: Confirmed Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Is-Admin-Project: True Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Domain-Id: default Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Domain-Name: Default Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Name: admin Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Role: member,reader,admin Jul 15 15:46:27.201902 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Roles: member,reader,admin Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant: admin Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant-Name: admin Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User: admin Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Domain-Id: default Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Domain-Name: Default Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Id: fb07001f45bb40c8b8c84b7d67d1c304 Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Name: admin Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: method: > Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: exception: Flavor 42 could not be found. Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: action_args: {'id': '42'} Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:46:27.203163 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:27.203988 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:27.205188 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-7192b6fb-42c9-4362-9587-98edef81e466 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:46:27.206419 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-7192b6fb-42c9-4362-9587-98edef81e466 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013955 Jul 15 15:46:27.206419 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 22/42] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Jul 15 15:46:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:46:28.182023 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-fa6cdce4-cc3a-4c5d-a18b-ee0e41b62c82 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:28.183035 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-fa6cdce4-cc3a-4c5d-a18b-ee0e41b62c82 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 15 15:46:28.183460 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 21/43] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:46:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:28.706769 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-65a2efff-5caa-4104-8764-d4f8d4cd55ea admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:28.712045 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.wsgi [None req-65a2efff-5caa-4104-8764-d4f8d4cd55ea admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-65a2efff-5caa-4104-8764-d4f8d4cd55ea admin admin] Request method failure captured: Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Accept: application/json Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Accept-Encoding: gzip, deflate Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Connection: keep-alive Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Content-Length: 0 Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Host: 10.222.0.98 Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Openstack-Api-Version: compute 2.90 Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Openstack-System-Scope: None Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: User-Agent: python-novaclient Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Auth-Token: gAAAAABi0YvUKFDcMH0ELw5hYhdF7l_ZMIId6tX8IaDdUuLg45R5FPSGnET24HuvlCeErsBtZSxmRjWx7T5kmrkkbISdHSE3v46xGuMcYJMjoztEkCI7e09HFAaB-KzD3C20xGUYf4rqhQLX-ClX768YzX7V_D-VTGLmSjBtnMCnvHmboZbF_S0 Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Domain-Id: None Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Domain-Name: None Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Identity-Status: Confirmed Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Is-Admin-Project: True Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Domain-Id: default Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Domain-Name: Default Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Name: admin Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Role: member,reader,admin Jul 15 15:46:28.713557 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Roles: member,reader,admin Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant: admin Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant-Name: admin Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User: admin Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Domain-Id: default Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Domain-Name: Default Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Id: fb07001f45bb40c8b8c84b7d67d1c304 Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Name: admin Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: method: > Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: exception: Flavor 84 could not be found. Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: action_args: {'id': '84'} Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:46:28.715018 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:28.716096 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.717371 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-65a2efff-5caa-4104-8764-d4f8d4cd55ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:46:28.718644 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-65a2efff-5caa-4104-8764-d4f8d4cd55ea admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395334 Jul 15 15:46:28.718644 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 23/44] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Jul 15 15:46:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:46:28.724557 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-c3116717-6ddf-477a-9834-b4488969f715 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:28.738090 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-c3116717-6ddf-477a-9834-b4488969f715 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017112 Jul 15 15:46:28.738605 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 22/45] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Jul 15 15:46:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:46:28.747698 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-86c1f58c-e0f4-466b-b42c-1d8077b5b165 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:28.761667 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-86c1f58c-e0f4-466b-b42c-1d8077b5b165 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017434 Jul 15 15:46:28.762167 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 24/46] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Jul 15 15:46:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:46:28.771555 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-2001a3f6-7b0c-41c7-bc64-13907a4950b4 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:28.776808 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.wsgi [None req-2001a3f6-7b0c-41c7-bc64-13907a4950b4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-2001a3f6-7b0c-41c7-bc64-13907a4950b4 admin admin] Request method failure captured: Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Accept: application/json Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Accept-Encoding: gzip, deflate Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Connection: keep-alive Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Content-Length: 0 Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Host: 10.222.0.98 Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Openstack-Api-Version: compute 2.90 Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Openstack-System-Scope: None Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: User-Agent: python-novaclient Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Auth-Token: gAAAAABi0YvUKFDcMH0ELw5hYhdF7l_ZMIId6tX8IaDdUuLg45R5FPSGnET24HuvlCeErsBtZSxmRjWx7T5kmrkkbISdHSE3v46xGuMcYJMjoztEkCI7e09HFAaB-KzD3C20xGUYf4rqhQLX-ClX768YzX7V_D-VTGLmSjBtnMCnvHmboZbF_S0 Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Domain-Id: None Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Domain-Name: None Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Identity-Status: Confirmed Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Is-Admin-Project: True Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Domain-Id: default Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Domain-Name: Default Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Name: admin Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Role: member,reader,admin Jul 15 15:46:28.778302 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Roles: member,reader,admin Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant: admin Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant-Name: admin Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User: admin Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Domain-Id: default Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Domain-Name: Default Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Id: fb07001f45bb40c8b8c84b7d67d1c304 Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Name: admin Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: method: > Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: exception: Flavor 84 could not be found. Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: action_args: {'id': '84'} Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:46:28.779875 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:28.780813 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:28.782194 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-2001a3f6-7b0c-41c7-bc64-13907a4950b4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:46:28.783464 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-2001a3f6-7b0c-41c7-bc64-13907a4950b4 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011540 Jul 15 15:46:28.783464 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 23/47] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Jul 15 15:46:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 15 15:46:29.785350 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-86c1f58c-e0f4-466b-b42c-1d8077b5b165 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:29.786351 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-86c1f58c-e0f4-466b-b42c-1d8077b5b165 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 15 15:46:29.786747 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 25/48] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:46:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:30.320094 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-57835cdf-15b2-4823-84d3-b6c8504f3eb7 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:30.325848 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.wsgi [None req-57835cdf-15b2-4823-84d3-b6c8504f3eb7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-57835cdf-15b2-4823-84d3-b6c8504f3eb7 admin admin] Request method failure captured: Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Accept: application/json Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Accept-Encoding: gzip, deflate Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Connection: keep-alive Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Content-Length: 0 Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Host: 10.222.0.98 Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Openstack-Api-Version: compute 2.90 Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Openstack-System-Scope: None Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: User-Agent: python-novaclient Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Auth-Token: gAAAAABi0YvVdIaLMfLOGRk_Iw_ug_cao_WmeVzSzZXvAP19M3o9pm7rEL2TO39KvcV_zYr9TG-awFJ1ZGpXbwYfob1xgtCHLyrpJTSTqvmcMARIMd2HAZ4u3yP6Ooes0bk5EDMRjumVED62GuSzrioBn9jb-oQTzDnqMzJLmRxzU2i8mqW0QFo Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Domain-Id: None Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Domain-Name: None Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Identity-Status: Confirmed Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Is-Admin-Project: True Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Domain-Id: default Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Domain-Name: Default Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Project-Name: admin Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Role: member,reader,admin Jul 15 15:46:30.327350 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Roles: member,reader,admin Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant: admin Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-Tenant-Name: admin Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User: admin Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Domain-Id: default Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Domain-Name: Default Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Id: fb07001f45bb40c8b8c84b7d67d1c304 Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: X-User-Name: admin Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: method: > Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: exception: Flavor 451 could not be found. Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: action_args: {'id': '451'} Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:46:30.338054 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:30.338943 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.340009 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-57835cdf-15b2-4823-84d3-b6c8504f3eb7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:46:30.340990 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-57835cdf-15b2-4823-84d3-b6c8504f3eb7 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.403430 Jul 15 15:46:30.340990 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 24/49] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Jul 15 15:46:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:46:30.341115 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-06d2cb48-7468-4514-8443-8d14344a8329 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:30.352772 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-06d2cb48-7468-4514-8443-8d14344a8329 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017306 Jul 15 15:46:30.353280 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 26/50] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Jul 15 15:46:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:46:30.362589 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:30.378109 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019008 Jul 15 15:46:30.379338 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 25/51] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Jul 15 15:46:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:46:30.388012 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-96131eed-ec94-4b06-9ef5-b3d9138411f9 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:30.393884 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.wsgi [None req-96131eed-ec94-4b06-9ef5-b3d9138411f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-96131eed-ec94-4b06-9ef5-b3d9138411f9 admin admin] Request method failure captured: Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Accept: application/json Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Accept-Encoding: gzip, deflate Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Connection: keep-alive Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Content-Length: 0 Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Host: 10.222.0.98 Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Openstack-Api-Version: compute 2.90 Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Openstack-System-Scope: None Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: User-Agent: python-novaclient Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Auth-Token: gAAAAABi0YvVdIaLMfLOGRk_Iw_ug_cao_WmeVzSzZXvAP19M3o9pm7rEL2TO39KvcV_zYr9TG-awFJ1ZGpXbwYfob1xgtCHLyrpJTSTqvmcMARIMd2HAZ4u3yP6Ooes0bk5EDMRjumVED62GuSzrioBn9jb-oQTzDnqMzJLmRxzU2i8mqW0QFo Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Domain-Id: None Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Domain-Name: None Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Identity-Status: Confirmed Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Is-Admin-Project: True Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Domain-Id: default Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Domain-Name: Default Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Project-Name: admin Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Role: member,reader,admin Jul 15 15:46:30.395386 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Roles: member,reader,admin Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c42afd51dd0d44aba511a26dccae48ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant: admin Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant-Id: c42afd51dd0d44aba511a26dccae48ce Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-Tenant-Name: admin Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User: admin Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Domain-Id: default Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Domain-Name: Default Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Id: fb07001f45bb40c8b8c84b7d67d1c304 Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: X-User-Name: admin Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: method: > Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: exception: Flavor 451 could not be found. Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: action_args: {'id': '451'} Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:46:30.396937 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:30.397764 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: ERROR nova.api.openstack.wsgi Jul 15 15:46:30.398803 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-96131eed-ec94-4b06-9ef5-b3d9138411f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:46:30.399861 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-96131eed-ec94-4b06-9ef5-b3d9138411f9 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012253 Jul 15 15:46:30.399861 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 27/52] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Jul 15 15:46:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:46:31.364805 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:31.365942 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 15 15:46:31.366328 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 26/53] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:46:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:31.886250 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-7c63bfba-8700-45b7-bd43-357589fc5637 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:31.963254 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-7c63bfba-8700-45b7-bd43-357589fc5637 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.459975 Jul 15 15:46:31.963819 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 28/54] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Jul 15 15:46:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:46:32.931579 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:32.932579 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 15 15:46:32.932962 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 27/55] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:46:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:33.472743 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-0bad86c8-8944-4cfd-a2fe-b1586dab1cc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:33.614366 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-0bad86c8-8944-4cfd-a2fe-b1586dab1cc8 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.545457 Jul 15 15:46:33.614835 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 29/56] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Jul 15 15:46:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:46:34.583553 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:34.584581 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 15 15:46:34.584972 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 28/57] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:46:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:35.107935 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-a2a6cea3-be8c-4b21-9b15-3414f4fac0f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:35.196727 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-a2a6cea3-be8c-4b21-9b15-3414f4fac0f0 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.472326 Jul 15 15:46:35.197256 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 30/58] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Jul 15 15:46:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:46:36.164034 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:36.165031 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 15 15:46:36.165418 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 29/59] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:36.727819 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-59e10755-14ef-4e09-883c-51557d9742a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:36.882228 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-59e10755-14ef-4e09-883c-51557d9742a6 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.578825 Jul 15 15:46:36.882688 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 31/60] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Jul 15 15:46:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:46:37.847544 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:37.848568 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 15 15:46:37.848960 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 30/61] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:38.374864 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-6d3fb260-ce0b-403a-acc8-7a59d2c21590 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:38.394870 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-6d3fb260-ce0b-403a-acc8-7a59d2c21590 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.399787 Jul 15 15:46:38.395418 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 32/62] 10.222.0.98 () {60 vars in 1202 bytes} [Fri Jul 15 15:46:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:47:30.041682 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:30.042823 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-6087238d-bcfb-431a-917e-9b59f66b341f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 15 15:47:30.043213 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 31/63] 10.222.0.98 () {54 vars in 930 bytes} [Fri Jul 15 15:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:47:30.054243 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:30.436952 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-91004f14-2d27-471d-a4f7-c830d94278c2 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:30.455924 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-91004f14-2d27-471d-a4f7-c830d94278c2 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406196 Jul 15 15:47:30.456387 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 33/64] 10.222.0.98 () {60 vars in 1291 bytes} [Fri Jul 15 15:47:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:47:30.477959 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG dbcounter [-] [115561] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=115561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:30.481653 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-46512a16-524a-41cf-aba0-cf8b012bbc92 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:30.489622 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-46512a16-524a-41cf-aba0-cf8b012bbc92 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013094 Jul 15 15:47:30.491128 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 32/65] 10.222.0.98 () {60 vars in 1282 bytes} [Fri Jul 15 15:47:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:47:30.501431 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-e45d5575-4e7f-4c2f-85f1-34ba2c6ccc2f admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:30.509081 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-e45d5575-4e7f-4c2f-85f1-34ba2c6ccc2f admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011231 Jul 15 15:47:30.509590 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 34/66] 10.222.0.98 () {60 vars in 1285 bytes} [Fri Jul 15 15:47:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:47:30.521953 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:30.530318 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012289 Jul 15 15:47:30.530852 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 33/67] 10.222.0.98 () {60 vars in 1285 bytes} [Fri Jul 15 15:47:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:47:30.543850 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-1b22d998-8d30-4338-92ac-51faaf8d7488 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:30.551747 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-1b22d998-8d30-4338-92ac-51faaf8d7488 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012009 Jul 15 15:47:30.552268 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 35/68] 10.222.0.98 () {60 vars in 1282 bytes} [Fri Jul 15 15:47:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:51:10.974466 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:51:10.975502 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 15 15:51:10.975887 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 34/69] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:51:11.116578 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_api:SELECT=6 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:51:11.277177 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-b159f9e1-dea4-42f4-a323-1c6519fb8938 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:51:11.278352 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:51:11.278352 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: warnings.warn(msg) Jul 15 15:51:11.279631 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-b159f9e1-dea4-42f4-a323-1c6519fb8938 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:51:11.280070 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-b159f9e1-dea4-42f4-a323-1c6519fb8938 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:51:11.280850 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-b159f9e1-dea4-42f4-a323-1c6519fb8938 admin admin] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:51:11.281273 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-b159f9e1-dea4-42f4-a323-1c6519fb8938 admin admin] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:51:11.315050 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-b159f9e1-dea4-42f4-a323-1c6519fb8938 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199986 Jul 15 15:51:11.315637 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 36/70] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Jul 15 15:51:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:51:12.144464 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:51:12.145468 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 15 15:51:12.145857 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 35/71] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:51:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:51:12.342234 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-aa08091d-b9fe-4a17-89b5-fa275afdc410 admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:51:12.343550 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:51:12.343550 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: warnings.warn(msg) Jul 15 15:51:12.345109 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-aa08091d-b9fe-4a17-89b5-fa275afdc410 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:51:12.345673 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-aa08091d-b9fe-4a17-89b5-fa275afdc410 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:51:12.346470 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-aa08091d-b9fe-4a17-89b5-fa275afdc410 admin admin] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:51:12.346897 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-aa08091d-b9fe-4a17-89b5-fa275afdc410 admin admin] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:51:12.367134 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-aa08091d-b9fe-4a17-89b5-fa275afdc410 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077558 Jul 15 15:51:12.368441 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 37/72] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Jul 15 15:51:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:51:23.629926 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:51:23.630929 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 15 15:51:23.631338 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 36/73] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:51:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:51:23.786032 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_cell0:SELECT=4 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:51:23.786750 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_cell1:SELECT=4 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:51:23.787378 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG dbcounter [-] [115562] Writing DB stats nova_api:SELECT=8 {{(pid=115562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:51:23.835665 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-c65e3103-2e50-4707-bb63-a1e48fc99fbf admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:51:23.836970 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:51:23.836970 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: warnings.warn(msg) Jul 15 15:51:23.838151 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-c65e3103-2e50-4707-bb63-a1e48fc99fbf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:51:23.838626 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-c65e3103-2e50-4707-bb63-a1e48fc99fbf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:51:23.839436 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-c65e3103-2e50-4707-bb63-a1e48fc99fbf admin admin] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:51:23.839863 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-c65e3103-2e50-4707-bb63-a1e48fc99fbf admin admin] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:51:23.865530 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-c65e3103-2e50-4707-bb63-a1e48fc99fbf admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083831 Jul 15 15:51:23.866081 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 38/74] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Jul 15 15:51:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:51:24.689919 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: DEBUG nova.api.openstack.wsgi [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] Calling method '>' {{(pid=115561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:51:24.690929 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: INFO nova.api.openstack.requestlog [None req-33304e01-7c09-4491-837f-cd54a9e539f2 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 15 15:51:24.691343 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: [pid: 115561|app: 0|req: 37/75] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Jul 15 15:51:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:51:24.887877 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG nova.api.openstack.wsgi [None req-f7fd572b-8ffa-40ab-9323-5c46c3110d9e admin admin] Calling method '>' {{(pid=115562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:51:24.889049 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:51:24.889049 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: warnings.warn(msg) Jul 15 15:51:24.890238 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-f7fd572b-8ffa-40ab-9323-5c46c3110d9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:51:24.890676 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-f7fd572b-8ffa-40ab-9323-5c46c3110d9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:51:24.891506 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-f7fd572b-8ffa-40ab-9323-5c46c3110d9e admin admin] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:51:24.891930 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: DEBUG oslo_concurrency.lockutils [None req-f7fd572b-8ffa-40ab-9323-5c46c3110d9e admin admin] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:51:24.913336 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: INFO nova.api.openstack.requestlog [None req-f7fd572b-8ffa-40ab-9323-5c46c3110d9e admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081608 Jul 15 15:51:24.913897 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: [pid: 115562|app: 0|req: 39/76] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Jul 15 15:51:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:52:25.324036 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: Fri Jul 15 15:52:25 2022 - graceful shutdown triggered... Jul 15 15:52:25.324140 dv-cinder-835878-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 15 15:52:25.325074 dv-cinder-835878-3-iscsi devstack@n-api.service[115561]: Gracefully killing worker 1 (pid: 115561)... Jul 15 15:52:25.325498 dv-cinder-835878-3-iscsi devstack@n-api.service[115562]: Gracefully killing worker 2 (pid: 115562)... Jul 15 15:52:26.326169 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: worker 1 buried after 1 seconds Jul 15 15:52:26.326612 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: worker 2 buried after 1 seconds Jul 15 15:52:26.326612 dv-cinder-835878-3-iscsi devstack@n-api.service[115560]: goodbye to uWSGI. Jul 15 15:52:26.327803 dv-cinder-835878-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 15 15:52:26.328359 dv-cinder-835878-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 15 15:52:26.331130 dv-cinder-835878-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 15:52:26.344003 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 15:52:26 2022] *** Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: nodename: dv-cinder-835878-3-iscsi Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: machine: x86_64 Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: clock source: unix Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: pcre jit disabled Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: detected number of CPU cores: 4 Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: current working directory: / Jul 15 15:52:26.346142 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: detected binary path: /usr/bin/uwsgi-core Jul 15 15:52:26.346846 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: your processes number limit is 47680 Jul 15 15:52:26.346846 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: your memory page size is 4096 bytes Jul 15 15:52:26.346846 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: detected max file descriptor number: 2048 Jul 15 15:52:26.346846 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: lock engine: pthread robust mutexes Jul 15 15:52:26.346846 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: thunder lock: enabled Jul 15 15:52:26.346846 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 15:52:26.346846 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 15:52:26.386963 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: Python main interpreter initialized at 0x557e10a649c0 Jul 15 15:52:26.386963 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: python threads support enabled Jul 15 15:52:26.386963 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: your server socket listen backlog is limited to 100 connections Jul 15 15:52:26.386963 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: your mercy for graceful operations on workers is 90 seconds Jul 15 15:52:26.387405 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 15:52:26.387405 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: *** Operational MODE: preforking *** Jul 15 15:52:26.387699 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: *** uWSGI is running in multiple interpreter mode *** Jul 15 15:52:26.387699 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: spawned uWSGI master process (pid: 130077) Jul 15 15:52:26.390575 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: spawned uWSGI worker 1 (pid: 130090, cores: 1) Jul 15 15:52:26.390575 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: spawned uWSGI worker 2 (pid: 130091, cores: 1) Jul 15 15:52:26.390575 dv-cinder-835878-3-iscsi devstack@n-api.service[130077]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 15:52:26.387893 dv-cinder-835878-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 15:52:27.046592 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 15:52:27.071956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 15:52:28.210660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:52:28.210660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: from cryptography.utils import int_from_bytes Jul 15 15:52:28.211273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:52:28.211273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: from cryptography.utils import int_from_bytes Jul 15 15:52:28.269884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:52:28.269884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: from cryptography.utils import int_from_bytes Jul 15 15:52:28.270501 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:52:28.270501 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: from cryptography.utils import int_from_bytes Jul 15 15:52:30.489053 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:52:30.489605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:52:30.489833 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:52:30.490198 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:52:30.490450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:52:30.490839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.491163 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.491516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.491839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.492171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.492482 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.492800 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.493121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.493451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.493713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.494030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.494352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-3-iscsi {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.495213 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.495552 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.495865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.496191 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.496499 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.496824 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.497129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.497628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.498085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.498394 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.498706 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.499046 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.499399 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.499713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.500034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.500342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.500666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.500977 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.501375 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-3-iscsi {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.501691 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.502004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.502317 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.502729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.503042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.503374 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.503700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.504024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.504330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.504667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.504988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.505300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.505623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.505930 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.506239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.506544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.506862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.507165 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.507492 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.507745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.508052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.508374 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.508696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.509017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.509270 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.509521 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.509839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.510181 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.510494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.510803 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.511108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.511441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.511752 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.512058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.512366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.512670 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.512988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.513302 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.513622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.513929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.514247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.514642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.514894 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.515201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.515567 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.515895 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.516200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.516518 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.516850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.517146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.517447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.517752 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.518069 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.518401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.518705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.518956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.519257 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.519655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.519973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.520279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.520586 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.520891 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.521194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.521497 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.521803 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.522107 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.522411 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.522717 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.523021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.523344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.523651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.523955 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.524272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.524590 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.524896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.525201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.525508 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.526345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.526660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.526966 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.527266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.527605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.527911 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.528308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.528535 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.528841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.529146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.529462 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.529762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.530069 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.530388 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.530690 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.530994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.531327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.531626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.531931 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.532235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.532539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.532840 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.533138 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.533455 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.533774 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.534081 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.534387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.534690 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.535008 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.535366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.535700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.536042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.536367 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.536701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.537031 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.537347 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.537659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.537972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.538296 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.538607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.538919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.539231 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.539577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.539896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.540226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.540544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.540863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.541182 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.541570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.542363 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.542696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.543017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.543352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.543699 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.544044 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.544383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.544686 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.545007 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.545319 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.545631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.545943 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.546263 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.546644 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.546908 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.547228 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.547659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.547883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.548193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.548506 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.548817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.549153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.549467 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.549781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.550094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.550412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.550724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.551037 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.551368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.551675 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.552043 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.552281 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.552589 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.552892 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.553212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.553540 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.553846 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.554179 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.554483 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.554795 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.555105 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.555437 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.555744 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.556055 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.556371 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.556698 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.557002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.557336 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.557645 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.557967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.558273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.558577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.558891 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.559200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.559536 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.559852 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.560164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.560487 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.560799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.561114 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.561448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.561781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.562090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.562419 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.562745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.563059 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.563389 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.563701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.564005 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.564310 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.564612 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.564917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.565218 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.565522 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.565825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.566130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.566437 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.566759 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.567068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.567395 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.567702 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.568008 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.568348 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.568653 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.568995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.569329 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.569646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.569970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.570283 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.570598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.570907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.571217 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.571554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.571865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.572185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.572496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.572852 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.573592 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.573592 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.574099 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.574099 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.574396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.574717 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.575784 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.575784 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.575784 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.576237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.576380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.576679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.576826 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:52:30.577290 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.577444 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:52:30.577597 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.577749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:52:30.577899 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.578091 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:52:30.578338 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.578498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:52:30.578643 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.578643 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.578918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.579066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.579209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.579391 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.580498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.580700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.580859 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.581004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.581167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.581354 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.581555 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.581719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.582118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.582267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.582428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.582573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.582714 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.582714 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.582992 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.583142 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.583328 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.583505 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-3-iscsi {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.583649 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.583791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.583939 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.584081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.584234 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.584376 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.584524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.584674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.584823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.584979 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.585133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.585302 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.585455 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.585603 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.585746 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.585746 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.586023 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.586191 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.586344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.586485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.586633 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.586776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.587010 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.587155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.587355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.587504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.587656 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.587800 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.587955 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.588105 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.588254 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.588991 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.589140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.589282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.589432 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.589593 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.589737 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.589890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.589890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.590183 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-3-iscsi {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.590333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.590475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.590624 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.590766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.590922 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.591076 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.591225 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.591390 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.591562 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.591716 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.591872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.591872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.592151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.592151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.592420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.592420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.592700 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.592843 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.592991 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.593142 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.593283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.593443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.593591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.593733 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.593881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.594024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.594172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.594323 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.594464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.594611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.594752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.594893 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.595041 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.595202 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.595371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.595531 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.595708 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.595851 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.595992 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.595992 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.596283 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.596433 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.596581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.596581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.596858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.597049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.597218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.597361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.597510 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.597510 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.597850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.597994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.598145 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.598295 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.598448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.598603 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.598746 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.598898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.599150 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.599373 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.599373 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.599670 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.599820 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.599970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.600112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.600260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.600403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.600554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.600695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.600843 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.601002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.601151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.601308 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.601454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.601601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.601753 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.601895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.602036 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.602186 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.602341 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.602484 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.602626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.602775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.602928 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.603078 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.603227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.603412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.603557 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.603708 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.603859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.604593 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.604745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.604895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.605052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.605195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.605356 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.605510 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.605653 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.605794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.605945 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.606094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.606237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.606423 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.606572 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.606715 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.606866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.607015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.607157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.607411 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.607558 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.607711 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.607863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.608005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.608217 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.608374 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.608536 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.608691 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.608835 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.608983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.609143 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.609374 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.609540 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.609693 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.609844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.609995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.610144 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.610286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.610437 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.610594 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.610736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.610878 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.611027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.611176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.611355 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.611535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.611692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.611848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.612000 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.612150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.612306 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.612448 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.612590 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.612738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.612888 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.613030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.613181 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.613322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.613483 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.613634 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.613777 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.613918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.614069 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.614218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.614368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.614586 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.614738 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.614887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.615031 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.615180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.615375 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.615540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.615683 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.615833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.615987 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.616137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.616293 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.616450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.616599 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.616746 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.616902 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.617050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.617212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.617371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.617528 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.617684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.617840 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.617995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.618152 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.618310 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.618468 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.618617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.618774 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.618922 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.619083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.619240 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.619664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.619833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.619992 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.620149 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.620309 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.620458 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.620697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.620853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.621002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.621159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.621316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.621467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.621615 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.621792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.621951 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.622074 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.622205 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.622317 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.622414 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.622502 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.622593 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.622687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.622771 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.622865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.622949 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:52:30.623112 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623112 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623281 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623491 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623678 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623851 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.623943 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624033 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624117 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624302 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624386 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624747 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624852 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.624937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.625027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.625110 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.625200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.625364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.625542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.625701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.625856 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.626012 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.626170 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.626320 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.626475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.626631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.626787 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.626943 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.627101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.627260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.627464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.627623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.627802 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.627952 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.628109 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.628266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.628422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.628638 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.628792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.628950 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.629099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.629257 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.629415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.629690 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.629889 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.630051 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.630201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.630359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.630515 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.630693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.630930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.631094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.631288 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.631499 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.631657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.631807 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.631973 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.632132 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.632300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.632526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.632679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.632837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.632998 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.633164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.633316 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.633472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.633622 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.633776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.633941 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.634102 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.634251 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.634399 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.634554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.634710 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.634872 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.635023 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.635203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.635398 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.635557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.635708 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.635866 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.636023 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.636182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.636331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.636331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.636628 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.636787 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.636943 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.637101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.637307 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.637467 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.637626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.637783 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.637975 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.638138 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.638303 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.638460 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.638618 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.638819 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.638971 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.639129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.639286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.639286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.639715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.639866 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.640130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.640130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.640453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.640613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.640772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.640772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.641134 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.641134 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.641464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.641464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.641785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.641980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.642188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.642349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.642525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.642769 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.642926 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.643075 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.643235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.643419 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.643571 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.643735 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.643885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.644034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.644190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.644346 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.644576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.644733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.644733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.645093 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.645244 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.645401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.645565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.645715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.645864 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.646082 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.646248 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.646447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.646690 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.646884 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.647056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.647207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.647402 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.647569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.647730 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.647889 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.648108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.648272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.648422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.648629 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.648781 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.648937 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.649121 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.649315 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.649464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.649621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.649779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.649929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.650084 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.650349 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.650511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.650671 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.651390 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.651390 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.651684 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.651843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.652154 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.652324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.652483 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.653359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.653568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.653754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.653917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.654068 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.654225 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.654382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.654532 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.654701 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.654851 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.655009 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.655164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.655341 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.669420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.669606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.669798 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.669975 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.670128 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.670277 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.670436 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.670695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.670941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.671157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.671407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.671571 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.671725 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.671911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.672067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.672067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.672438 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.672438 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.672729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.672886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.673247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.673247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.673654 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.673840 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.674044 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.674201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.674365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.674525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.674686 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.674862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.675030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.675189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.675369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.675526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.675685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.675837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.675996 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.676870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.677043 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.677197 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.677354 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.677524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.677683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.677940 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678196 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678376 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678480 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678911 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.678993 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679174 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679270 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679708 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.679915 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680000 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680274 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680510 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680597 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680694 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680777 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680860 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.680860 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681035 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681035 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681186 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681619 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681708 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681873 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.681963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682165 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682348 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682438 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682624 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682803 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682891 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682981 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.682981 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.683145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.683145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.683505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.683646 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.683739 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.683828 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.683912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684097 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684181 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684356 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.684934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685096 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685176 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685528 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.685988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686152 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686327 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686415 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686505 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686588 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686588 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.686990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687148 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687242 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687436 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687694 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.687965 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688055 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688138 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688227 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688618 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688721 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.688907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689000 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689091 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689175 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689264 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689348 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689444 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689536 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689627 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689718 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689801 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689897 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.689988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690140 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690222 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690304 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690443 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690601 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690691 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690782 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690866 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.690948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691102 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691196 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691287 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691439 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691526 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691609 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691706 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691874 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.691956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692214 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692304 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692304 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692707 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692798 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.692881 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.693102 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.693197 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.693291 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.693377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.693459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.693757 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.693899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694022 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694147 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694259 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694376 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694493 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694613 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.694967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695348 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695437 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695588 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.695963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696262 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696416 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696694 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.696930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697016 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697165 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697240 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697310 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697377 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697691 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697784 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697858 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.697937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698440 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698516 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698614 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698614 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698829 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.698983 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699131 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699368 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699532 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699608 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699677 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699753 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699822 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699822 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.699962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.700033 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.700101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.700178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.700178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.703450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.703450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.703670 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.703747 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.703826 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.703897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.703897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704104 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704172 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704241 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704309 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704393 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704465 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704541 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.704975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705044 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705435 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705532 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705615 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705837 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.705999 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.706091 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.706163 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.706261 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.706496 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.706601 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.706797 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.707142 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.707390 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.707500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.707727 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.707828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.708046 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.708139 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.708362 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.708478 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.708670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.708776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.708994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.709089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.709300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.709419 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.709776 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.709882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.709957 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.710034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.710231 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.710320 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.710558 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.710682 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.710873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.711002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.711197 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.711343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.711538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.711631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.711852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.711944 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.712168 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.712304 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.712482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.712630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.712794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.712994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.713101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.713868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.713974 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.714211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.714311 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.714523 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.714619 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.714854 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.714988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.715169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.715476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.715592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.715713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.716215 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.716921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.716921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.717076 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.717158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.717236 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.717306 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.717382 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.717467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.718061 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.718169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.718169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.718300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.718369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.719436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.719548 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.719632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.719745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.719844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.719925 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.719996 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.720080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.720152 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.720220 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.720289 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.720356 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.720431 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.720741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.720846 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.721742 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.721841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.721916 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.721993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.722079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.722158 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.722230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.722306 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.722383 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.722462 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.722594 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724054 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724177 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724262 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724341 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724422 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724494 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724563 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724717 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724788 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724788 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.724927 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.725004 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.725073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.725142 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.725223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.725301 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.725959 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.726055 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.726130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.726209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.726209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.726355 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.726591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.726696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.726966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.727075 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.727163 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.727258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.727508 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.727603 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.736794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.736905 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737032 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737116 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737196 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737343 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737496 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737652 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737722 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737805 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737889 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.737968 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.738045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.738115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.738115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.738250 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739284 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739466 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739536 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739781 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739852 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.739930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740149 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740227 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740298 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740523 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.740696 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.741899 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.741995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.742078 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.742152 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.742232 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.742305 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.742655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.742753 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.742827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.742977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743130 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743199 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743470 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743683 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743751 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.743977 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.744054 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.744124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.744193 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.744261 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.744338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.744416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.744508 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.745638 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.745734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.745734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.745884 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.745962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.746034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.746103 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.746171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.746253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.746332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.746411 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.746411 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.747028 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.747110 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.747197 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.747277 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.747752 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.747839 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.747920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.747999 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.748079 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.748150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.748230 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749105 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749362 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749432 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749638 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.749941 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750080 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750296 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750440 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750596 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750667 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.750819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752432 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752572 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752642 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752800 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752873 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.752943 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753092 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753169 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753249 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753399 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753468 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753877 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.753954 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.754033 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.754105 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.754195 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.754280 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.754352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.754430 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.754500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.755848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.756017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.756185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.756338 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.756498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.756498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.756789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.756954 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.757126 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.757287 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.757440 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.757599 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.757762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.757926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.758078 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.758229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.758390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.759821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.760010 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.760196 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.760366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.760532 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.760702 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.760868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.761059 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.761571 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.761753 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.761923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.762085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.762246 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.762509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.762791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.762953 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.763118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.763280 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.763488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.763650 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.763895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.764673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.766110 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.766275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.766275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.766582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.766734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.766885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.767078 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.767238 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.767433 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.767607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.767772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.767973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:52:30.768172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.768172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.768172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.768172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.768172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.768172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.768172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.768172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.769175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.769175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.769175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.769175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.769175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.769175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.769175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.769175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.770182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.770182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.770182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.770182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.770182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.770182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.770182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.770182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.771033 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.771033 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.771761 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.771761 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.771761 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.772229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.772371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.772669 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.773011 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.773340 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.773909 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.774065 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.774292 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.774652 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.774974 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.775286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.775708 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.776572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.776896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.777217 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.777537 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.777860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.778181 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.778496 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.778812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.779136 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.779479 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.779815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.780158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.780485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.780807 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.781130 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.781993 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.782156 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.782357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.782806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.783229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.783611 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.783939 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.784266 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.784602 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.784916 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.785228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.785546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.785862 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.786171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.786629 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.786816 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.787128 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.787482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.787798 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.788403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.788770 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.789215 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.789444 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.789781 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.790216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.790541 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.790731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.791045 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.791388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.792679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.792679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.793108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.793251 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.793566 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.793884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.794195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.794514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.794826 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.795165 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.795505 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.795820 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.796131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.796450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.796840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.797069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.797380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.797691 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.798009 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.798318 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.798633 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.798944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.799449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.799630 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.800538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.800538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.800845 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.800990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.801177 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.801513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.801832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.802163 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.802859 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.802859 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.803345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.803495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.804068 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.804412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.804848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.805082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.805420 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.805733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.806066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.806355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.806685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.807003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.807444 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.807778 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.808072 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.808387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.808702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.809088 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.809594 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.809833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.810154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.810473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.810793 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.811107 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.811463 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.811831 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.812164 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.813031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.813031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.813525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.813525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.813825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.814037 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.814352 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.814678 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.815024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.815372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.815687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.816132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.816453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.817290 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.817290 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.817633 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.817952 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.818113 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.818343 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.818673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.818990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.819350 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.819745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.820034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.820364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.820677 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.820987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.821302 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.821620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.821947 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.822261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.822572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.823414 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.823414 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.823931 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.823931 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.824228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.824428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.824741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.825250 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.825548 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.825858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.826168 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.826476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.826785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.827100 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.827436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.827749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.828067 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.828364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.828673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.829021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.829360 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.829683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.830015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.830334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.830662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.830980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.831331 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.831660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.832253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.832569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.833428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.833428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.833797 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.834087 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.834323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.834648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.834967 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.835946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.835946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.835946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.836397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.836605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.836919 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.837241 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.837640 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.837985 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.838956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.839166 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.839534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.839833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.840158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.840482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.840983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.841338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.841966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.842299 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.842641 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.842980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.843327 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.843660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.843998 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.844364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.844687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.845043 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.845380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.845704 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.846024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.846338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:52:30.846590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:52:30.926257 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO dbcounter [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Registered counter for database nova_api Jul 15 15:52:30.949461 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:52:30.956450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writer thread running {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:52:30.998948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO dbcounter [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Registered counter for database nova_api Jul 15 15:52:31.014571 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.context [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7af00cbd-57c5-414c-96c9-6111e9479151(cell1) {{(pid=130091) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 15:52:31.018620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:31.019441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_db.sqlalchemy.engines [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:52:31.020316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:31.021145 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:31.023234 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:31.025316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO dbcounter [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Registered counter for database nova_cell0 Jul 15 15:52:31.026825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writer thread running {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:52:31.030091 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO dbcounter [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Registered counter for database nova_cell1 Jul 15 15:52:31.040216 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:52:31.042773 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:52:31.049702 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writer thread running {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:52:31.052027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writer thread running {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:52:31.086388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.context [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7af00cbd-57c5-414c-96c9-6111e9479151(cell1) {{(pid=130090) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 15:52:31.090439 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:31.092094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:31.092919 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:31.094900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:31.096939 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO dbcounter [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Registered counter for database nova_cell0 Jul 15 15:52:31.101149 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO dbcounter [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Registered counter for database nova_cell1 Jul 15 15:52:31.109140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_db.sqlalchemy.engines [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:52:31.111655 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_db.sqlalchemy.engines [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:52:31.120453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writer thread running {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:52:31.120803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writer thread running {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:52:31.202393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO dbcounter [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Registered counter for database nova_cell0 Jul 15 15:52:31.209601 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:52:31.216661 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writer thread running {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:52:31.271006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO dbcounter [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Registered counter for database nova_cell0 Jul 15 15:52:31.277784 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_db.sqlalchemy.engines [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:52:31.282291 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writer thread running {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:52:31.540480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: WARNING keystonemiddleware.auth_token [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:52:31.548481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: WARNING keystonemiddleware.auth_token [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:52:31.597230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: WARNING keystonemiddleware.auth_token [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:52:31.604495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: WARNING keystonemiddleware.auth_token [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:52:31.892137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: WARNING keystonemiddleware.auth_token [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:52:31.898254 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: WARNING keystonemiddleware.auth_token [None req-bcb47084-8ece-4680-9fcd-bc4364b6177d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:52:31.903692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557e10a649c0 pid: 130091 (default app) Jul 15 15:52:31.944335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: WARNING keystonemiddleware.auth_token [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:52:31.950357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: WARNING keystonemiddleware.auth_token [None req-eb440356-296f-4f61-8846-9174e4fec5e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:52:31.955687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557e10a649c0 pid: 130090 (default app) Jul 15 15:53:15.098555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:15.099754 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:15.101105 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:15.102324 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:15.345473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:15.347580 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:15.347580 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:15.351933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:15.926931 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4fa8a44a-5022-4ddc-ae58-5fe7a7b6b3b9 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Action: 'create', calling method: .version_select at 0x7f510cacdaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-234494544"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:16.124881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-edc82869-dfbf-4c61-95d6-48ed0323de5e tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Action: 'create', calling method: .version_select at 0x7f510c99caf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1238115457", "metadata": {"Type": "work"}}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:17.968331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4fa8a44a-5022-4ddc-ae58-5fe7a7b6b3b9 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.886300 Jul 15 15:53:17.970101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 1/1] 10.222.0.98 () {60 vars in 1154 bytes} [Fri Jul 15 15:53:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2890 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 15 15:53:17.986086 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d71df7a7-1f4d-4d55-9413-f8b9052eae99 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c864790>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:19.038208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d71df7a7-1f4d-4d55-9413-f8b9052eae99 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 200 len: 344 microversion: 2.1 time: 1.059452 Jul 15 15:53:19.041137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 2/2] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:17 2022] GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 344 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:19.106858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-edc82869-dfbf-4c61-95d6-48ed0323de5e tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.767035 Jul 15 15:53:19.109097 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 1/3] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Jul 15 15:53:15 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3771 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 15 15:53:19.123714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e521ddb7-4be2-4a98-98ea-fd9d6d7aedb6 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c864e50>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:19.262492 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e521ddb7-4be2-4a98-98ea-fd9d6d7aedb6 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.144806 Jul 15 15:53:19.267548 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 3/4] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:19 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:20.055738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-17880630-ff14-4380-8589-f89d8fe148f6 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c9b7700>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:20.275595 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a8fe9f8a-096a-458b-808b-2fd0c95020e8 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c864c10>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:20.377488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-17880630-ff14-4380-8589-f89d8fe148f6 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 200 len: 345 microversion: 2.1 time: 0.325351 Jul 15 15:53:20.391796 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 2/5] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:20 2022] GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 345 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:20.398167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-48ddbb6d-20db-47e7-9c41-8bceff25c4c7 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Action: 'create', calling method: .version_select at 0x7f510c86bd30>, body: {"snapshot": {"volume_id": "2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-995900634"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:20.506912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a8fe9f8a-096a-458b-808b-2fd0c95020e8 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 354 microversion: 2.1 time: 0.235059 Jul 15 15:53:20.507419 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 4/6] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:20 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:20.521647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-47909783-14af-4891-b316-67163f29754b tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c8645e0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:21.618804 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-48ddbb6d-20db-47e7-9c41-8bceff25c4c7 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.225852 Jul 15 15:53:21.620137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 3/7] 10.222.0.98 () {60 vars in 1161 bytes} [Fri Jul 15 15:53:20 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:21.630221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6b9be649-639a-46b1-ae15-fca61e7585ab tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c86baf0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:21.759771 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-47909783-14af-4891-b316-67163f29754b tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 354 microversion: 2.1 time: 1.244165 Jul 15 15:53:21.760712 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 5/8] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:20 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 354 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:21.778572 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2bab2bb0-3da9-4d2d-be09-9c126674acf8 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c872670>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:22.013517 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6b9be649-639a-46b1-ae15-fca61e7585ab tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.387179 Jul 15 15:53:22.020542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 4/9] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:21 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:22.059283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-306fcaac-49d9-44ca-8072-7ac9324ad9be tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510cacf700>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:22.375133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2bab2bb0-3da9-4d2d-be09-9c126674acf8 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 202 len: 0 microversion: 2.1 time: 0.601086 Jul 15 15:53:22.376063 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 6/10] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 15:53:21 2022] DELETE /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:53:22.384734 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4b36a032-e142-4ffb-94d2-cb07607d1227 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c864700>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:22.468777 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-306fcaac-49d9-44ca-8072-7ac9324ad9be tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.413744 Jul 15 15:53:22.474878 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 5/11] 10.222.0.98 () {58 vars in 1139 bytes} [Fri Jul 15 15:53:22 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:22.479721 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-77d41ad8-dd65-453b-a233-3f6291b33757 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c87fb80>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:22.529193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4b36a032-e142-4ffb-94d2-cb07607d1227 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.148021 Jul 15 15:53:22.530423 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 7/12] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:22 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:22.560409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-77d41ad8-dd65-453b-a233-3f6291b33757 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.084364 Jul 15 15:53:22.560988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 6/13] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:22 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:23.542065 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a2b64aba-54b9-4c97-9791-c4ebb0c6a241 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c864dc0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:23.577761 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dc50dfae-e2bc-4d81-9e30-f86b90505bce tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c86be50>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:23.650920 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dc50dfae-e2bc-4d81-9e30-f86b90505bce tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.082395 Jul 15 15:53:23.652161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 7/14] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:23 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:23.691108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a2b64aba-54b9-4c97-9791-c4ebb0c6a241 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.152781 Jul 15 15:53:23.691745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 8/15] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:23 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:24.664353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7c7fbd36-a7ad-48f9-ac16-584021b587f5 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c86bf70>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:24.704094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f0e1d152-ae59-492d-9d3c-641a6821e432 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c872550>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:24.805366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7c7fbd36-a7ad-48f9-ac16-584021b587f5 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.145781 Jul 15 15:53:24.806144 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 8/16] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:24 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:24.873225 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f0e1d152-ae59-492d-9d3c-641a6821e432 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.173437 Jul 15 15:53:24.877973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 9/17] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:24 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:24.898734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1401390951", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:25.087920 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] validate_networks() for [('6baee11f-f016-413f-b137-fd93cd808df0', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:53:25.819203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-42f8230f-c7fd-4f65-a929-f1800939749c tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c864b80>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:25.859170 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-42f8230f-c7fd-4f65-a929-f1800939749c tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.044862 Jul 15 15:53:25.863431 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 10/18] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:25 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:25.885504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-54773aed-b6cd-4a6a-8d6e-26cfc5a09c15 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c864670>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:25.993802 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-54773aed-b6cd-4a6a-8d6e-26cfc5a09c15 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.111936 Jul 15 15:53:25.999209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 11/19] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:25 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:26.870640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-90814719-de86-40d9-9b90-22d4c9bc26a3 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c872700>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:26.954775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-90814719-de86-40d9-9b90-22d4c9bc26a3 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.088420 Jul 15 15:53:26.957976 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 12/20] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:26 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:27.006292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b3555a1c-e2a1-4cff-901d-ca1b04dfb6c2 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c872e50>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:27.094627 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b3555a1c-e2a1-4cff-901d-ca1b04dfb6c2 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.092271 Jul 15 15:53:27.095787 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 13/21] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:27 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:27.854454 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:53:27.855010 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:53:27.858228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:53:27.858517 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:53:27.858927 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:53:27.924904 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:27.925573 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:27.932377 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:27.932921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:27.951977 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1978974513", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "networks": [{"uuid": "809b73e0-9e4a-4f67-a111-8d9cc5d8a814"}]}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:28.063429 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Getting quotas for project 44cff0ae69e84de486ac2a6866ea6acb. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:53:28.083735 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Getting quotas for user 9005cb23317a4a05b58e99284824135e and project 44cff0ae69e84de486ac2a6866ea6acb. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:53:28.150797 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:53:28.167372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:53:28.230265 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] validate_networks() for [('809b73e0-9e4a-4f67-a111-8d9cc5d8a814', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:53:28.485097 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c6f560fe-1911-4883-8607-390b301f1abb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.677862 Jul 15 15:53:28.486213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 9/22] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:53:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:53:28.491199 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-55dfe48b-184a-40a8-867a-f7d1f22d49a6 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510c789280>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:28.554746 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-55dfe48b-184a-40a8-867a-f7d1f22d49a6 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 287 microversion: 2.1 time: 0.067291 Jul 15 15:53:28.561131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 10/23] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:28 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:28.566037 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c192373c-8349-4079-9406-6276094bcac0 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510c789940>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:28.687785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c192373c-8349-4079-9406-6276094bcac0 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.124887 Jul 15 15:53:28.688045 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 11/24] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:28 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:28.692581 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c9d29800-1a36-4e97-acfb-cde2124da0c7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:28.693988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c9d29800-1a36-4e97-acfb-cde2124da0c7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:29.020656 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c9d29800-1a36-4e97-acfb-cde2124da0c7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:29.041426 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c9d29800-1a36-4e97-acfb-cde2124da0c7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1222 microversion: 2.1 time: 0.352293 Jul 15 15:53:29.042355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 12/25] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:28 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1222 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:29.050859 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-15dc553d-12b9-469c-94d5-e5b11965868d tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510b725e50>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:29.290692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-15dc553d-12b9-469c-94d5-e5b11965868d tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "DELETE /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 202 len: 0 microversion: 2.1 time: 0.247184 Jul 15 15:53:29.291561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 13/26] 10.222.0.98 () {58 vars in 1253 bytes} [Fri Jul 15 15:53:29 2022] DELETE /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:53:29.302329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-4254404", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:29.459903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] validate_networks() for [('6baee11f-f016-413f-b137-fd93cd808df0', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:53:29.966451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:53:29.967166 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:53:29.967684 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:53:29.968096 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:53:29.968575 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:53:30.005029 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:30.005480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:30.006341 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:30.006785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:30.069518 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Getting quotas for project a5644a8a1ae540e2b260c3d1bb2bea0f. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:53:30.079239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Getting quotas for user 8e90cd544b0745809f118964cbdc66bb and project a5644a8a1ae540e2b260c3d1bb2bea0f. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:53:30.104230 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:53:30.108063 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:53:30.255273 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:53:30.256298 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:53:30.261452 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:53:30.261452 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:53:30.261452 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:53:30.272836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:30.273296 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:30.274088 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:30.274690 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:30.305312 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Getting quotas for project 44cff0ae69e84de486ac2a6866ea6acb. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:53:30.311104 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Getting quotas for user 9005cb23317a4a05b58e99284824135e and project 44cff0ae69e84de486ac2a6866ea6acb. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:53:30.342853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:53:30.347181 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:53:30.423009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-02362423-a9fd-405c-b364-8bae925061a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.639349 Jul 15 15:53:30.423861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 14/27] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 15:53:30.526714 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c934082e-8687-4a9d-9818-046554f3661c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.228035 Jul 15 15:53:30.527442 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 14/28] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:53:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:53:30.534975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-40f8159c-44dc-46fc-a69d-3dfdc3fa323c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'create', calling method: .version_select at 0x7f510c7871f0>, body: {"keypair": {"name": "tempest-keypair-17495743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIka4y7Tc5gT7vyf4sVzpwhWRWqhE9a3S90zH18cR6RF76xFuvjl4crtxlcWjxOqg6PsU76eKWuw8wlf1J4R37nODho/Ojj7rteoDMOdqXPP94e5qvWhMuptNdozIN1Gg=="}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:30.541245 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b1c590c9-e6e6-471d-b68d-fa646068c53a tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510d247820>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:30.573879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-40f8159c-44dc-46fc-a69d-3dfdc3fa323c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Getting quotas for project 7df1ad577ddf4dc8a9a75ad1a1337ffe. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:53:30.581064 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-40f8159c-44dc-46fc-a69d-3dfdc3fa323c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Getting quotas for user ac8dfa5c97594e74a6839d91b292adcd and project 7df1ad577ddf4dc8a9a75ad1a1337ffe. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:53:30.647608 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b1c590c9-e6e6-471d-b68d-fa646068c53a tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.115302 Jul 15 15:53:30.647824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 15/29] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:30 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:30.654142 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c36362dd-9453-4351-acc8-d39269480684 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510b743430>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:30.777089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c36362dd-9453-4351-acc8-d39269480684 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.127837 Jul 15 15:53:30.777702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 16/30] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:30 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:30.791772 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-40f8159c-44dc-46fc-a69d-3dfdc3fa323c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.356300 Jul 15 15:53:30.792389 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 15/31] 10.222.0.98 () {62 vars in 1199 bytes} [Fri Jul 15 15:53:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 368 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 15 15:53:30.816658 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-130eecfa-3655-44b8-8c83-f2944bb0c5c4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:30.822000 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-130eecfa-3655-44b8-8c83-f2944bb0c5c4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:30.942276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c9e56c35-7019-4c6a-bb1d-84cdbe312a7f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'create', calling method: .version_select at 0x7f510b743c10>, body: {"keypair": {"name": "tempest-keypair-508257415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBbiBjOpSl5FnO8zZtUN+t9p1bsem4prH+/3ju3H2sHzWEq0YxceRb4r/JD4Ag50FiWGUBtM38EFcDyKFF6grYgTfmdxj13A3i12LOrzl566yQfiV+1mEaDIFq/2ktCLQ=="}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:31.020493 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c9e56c35-7019-4c6a-bb1d-84cdbe312a7f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Getting quotas for project 93e4d5ff424c4e4fa5dd81c20cc920d0. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:53:31.032742 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c9e56c35-7019-4c6a-bb1d-84cdbe312a7f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Getting quotas for user 78db558bb3ea4161b4a54e62f9ec3bd6 and project 93e4d5ff424c4e4fa5dd81c20cc920d0. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:53:31.104673 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-130eecfa-3655-44b8-8c83-f2944bb0c5c4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:31.137402 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-130eecfa-3655-44b8-8c83-f2944bb0c5c4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1215 microversion: 2.1 time: 0.343752 Jul 15 15:53:31.138148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 16/32] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:30 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1215 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:31.143789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f7c8f1c3-8b47-45de-894a-3446169138e2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:31.145222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f7c8f1c3-8b47-45de-894a-3446169138e2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:31.234146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f7c8f1c3-8b47-45de-894a-3446169138e2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:31.241763 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c9e56c35-7019-4c6a-bb1d-84cdbe312a7f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.462565 Jul 15 15:53:31.243679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 17/33] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 15:53:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:31.260447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f7c8f1c3-8b47-45de-894a-3446169138e2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1219 microversion: 2.1 time: 0.121005 Jul 15 15:53:31.264418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 17/34] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:31 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:31.674238 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-16f4ffe0-9f13-49b4-ba4e-c6c2905e14d9 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510b6dc670>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:31.725151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-16f4ffe0-9f13-49b4-ba4e-c6c2905e14d9 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.066836 Jul 15 15:53:31.725883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 18/35] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:31 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:31.790181 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ea86381a-e2c4-4cde-8ae7-148c935dba26 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510aee2280>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:31.869458 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ea86381a-e2c4-4cde-8ae7-148c935dba26 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.082191 Jul 15 15:53:31.869458 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 18/36] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:31 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:32.154568 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5841a46a-821d-40ee-a08d-df7b994a5efb tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:32.155210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5841a46a-821d-40ee-a08d-df7b994a5efb tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:32.284390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-410249b2-084a-4b00-bcf2-db87efe0abb1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:32.285005 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-410249b2-084a-4b00-bcf2-db87efe0abb1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:32.292469 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-410249b2-084a-4b00-bcf2-db87efe0abb1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:32.292658 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-410249b2-084a-4b00-bcf2-db87efe0abb1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:32.294381 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-410249b2-084a-4b00-bcf2-db87efe0abb1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:32.294982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-410249b2-084a-4b00-bcf2-db87efe0abb1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:32.318117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5841a46a-821d-40ee-a08d-df7b994a5efb tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:32.342273 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5841a46a-821d-40ee-a08d-df7b994a5efb tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1215 microversion: 2.1 time: 0.190188 Jul 15 15:53:32.351262 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 19/37] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:32 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:32.525473 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-410249b2-084a-4b00-bcf2-db87efe0abb1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:32.548580 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-410249b2-084a-4b00-bcf2-db87efe0abb1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1223 microversion: 2.1 time: 0.267819 Jul 15 15:53:32.551226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 19/38] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:32 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1223 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:32.737623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-67a3361e-406b-4d85-9ad4-890d7d340a01 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510b6dcc10>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:32.790662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-67a3361e-406b-4d85-9ad4-890d7d340a01 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 200 len: 286 microversion: 2.1 time: 0.056814 Jul 15 15:53:32.795738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 20/39] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:32 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:32.881599 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c7f17da4-16b3-4035-a97a-28ae53466a5a tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510ae5b430>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:32.954219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c7f17da4-16b3-4035-a97a-28ae53466a5a tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 200 len: 353 microversion: 2.1 time: 0.077144 Jul 15 15:53:32.954821 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 20/40] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:32 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:33.368304 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d3d26503-b2ec-4911-a44b-d8f83b638ba8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:33.371159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d3d26503-b2ec-4911-a44b-d8f83b638ba8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:33.386161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d3d26503-b2ec-4911-a44b-d8f83b638ba8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:33.388182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d3d26503-b2ec-4911-a44b-d8f83b638ba8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:33.391441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d3d26503-b2ec-4911-a44b-d8f83b638ba8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:33.392083 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d3d26503-b2ec-4911-a44b-d8f83b638ba8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:33.567967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b8a461dd-6935-42e7-8104-d6ee246bc0ee tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:33.569228 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b8a461dd-6935-42e7-8104-d6ee246bc0ee tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:33.612581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8a461dd-6935-42e7-8104-d6ee246bc0ee tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:33.615230 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8a461dd-6935-42e7-8104-d6ee246bc0ee tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:33.617318 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8a461dd-6935-42e7-8104-d6ee246bc0ee tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:33.644415 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8a461dd-6935-42e7-8104-d6ee246bc0ee tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:33.718795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d3d26503-b2ec-4911-a44b-d8f83b638ba8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:33.744525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d3d26503-b2ec-4911-a44b-d8f83b638ba8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1211 microversion: 2.1 time: 0.387064 Jul 15 15:53:33.758278 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 21/41] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:33 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1211 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:33.802832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1358cef6-bd24-4ee4-9907-d96fb18eb5f1 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510ae59040>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:33.805277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b8a461dd-6935-42e7-8104-d6ee246bc0ee tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:33.817094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b8a461dd-6935-42e7-8104-d6ee246bc0ee tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1271 microversion: 2.1 time: 0.253718 Jul 15 15:53:33.829527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 21/42] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:33 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:33.872944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-1358cef6-bd24-4ee4-9907-d96fb18eb5f1 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] HTTP exception thrown: Snapshot 7971a841-d27b-446d-93c2-9e52028a2c4a could not be found. Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1358cef6-bd24-4ee4-9907-d96fb18eb5f1 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Request method failure captured: Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a HTTP/1.1 Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y1qUQLlzQyN1HfMCAQWG5l0lkOIBoO1B9hyzwx9h7V5rkjY5jPadhNcol0qj1PbiGDwjWp5yzYaknoTQpJjqqVTaKrlpOgnzJ0Q7JsCILpaDw7s5eH1zht51YQtA223ydCQUPR0_fG1Zq4gExr_wQfVngOQ8yGao-0uwU_gOSQMvf8 Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: c5b5c3ebb2ec42988f6203ec34392dc6 Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 15:53:33.901122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: c5b5c3ebb2ec42988f6203ec34392dc6 Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-VolumesSnapshotsTestJSON-196686007-project Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 2ff316f85f3e40178a0e7354a123e483 Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-VolumesSnapshotsTestJSON-196686007-project Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Snapshot 7971a841-d27b-446d-93c2-9e52028a2c4a could not be found. Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '7971a841-d27b-446d-93c2-9e52028a2c4a'} Jul 15 15:53:33.903459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7971a841-d27b-446d-93c2-9e52028a2c4a could not be found. (HTTP 404) (Request-ID: req-d498add6-d803-433d-8614-11dbeec181cf) Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:33.904118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:53:33.905129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7971a841-d27b-446d-93c2-9e52028a2c4a could not be found. Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 15 15:53:33.907108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7971a841-d27b-446d-93c2-9e52028a2c4a could not be found. Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7971a841-d27b-446d-93c2-9e52028a2c4a could not be found. Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1358cef6-bd24-4ee4-9907-d96fb18eb5f1 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Returning 404 to user: Snapshot 7971a841-d27b-446d-93c2-9e52028a2c4a could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1358cef6-bd24-4ee4-9907-d96fb18eb5f1 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a" status: 404 len: 111 microversion: 2.1 time: 0.103860 Jul 15 15:53:33.909359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 22/43] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Jul 15 15:53:33 2022] GET /compute/v2.1/os-snapshots/7971a841-d27b-446d-93c2-9e52028a2c4a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 15:53:33.913956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b02d4215-a2e4-4a1c-a6b4-2d3d57ad3e61 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510ae0e820>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:33.969164 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-359caaab-ba95-4119-8be9-0394a818fc23 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Calling method '.version_select at 0x7f510ae66670>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:35.188400 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b02d4215-a2e4-4a1c-a6b4-2d3d57ad3e61 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 202 len: 0 microversion: 2.1 time: 1.280392 Jul 15 15:53:35.192059 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 22/44] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 15:53:33 2022] DELETE /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 0 bytes in 1283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:53:35.202418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4e08c8ff-6aaa-47c1-b37e-9d25c25b2c71 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:35.203331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4e08c8ff-6aaa-47c1-b37e-9d25c25b2c71 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:35.254239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e08c8ff-6aaa-47c1-b37e-9d25c25b2c71 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:35.254998 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e08c8ff-6aaa-47c1-b37e-9d25c25b2c71 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:35.256267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e08c8ff-6aaa-47c1-b37e-9d25c25b2c71 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:35.256972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e08c8ff-6aaa-47c1-b37e-9d25c25b2c71 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:35.280717 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-359caaab-ba95-4119-8be9-0394a818fc23 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] HTTP exception thrown: Volume ea026e10-12f9-49cb-afae-d3b48858e29c could not be found. Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-359caaab-ba95-4119-8be9-0394a818fc23 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Request method failure captured: Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c HTTP/1.1 Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y1r7uE-OqLFwpUswfZQ1jDh1Eo0nNWTrJp-qei-3j42wZjPQA_wWER1aATVbl0m4TnfewegEikxPqkFUHMc7YdUXUGlPCInk6q0XRPN1DHiu7qU7zjDhtM2pMDCYKJR6dDxA3deO8Erlr-lT3uM7_CXOBaX1tPZ1iFfByRSdvKOfY8 Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 5677770f291d42e493b4ef0dd346d049 Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-VolumesGetTestJSON-464684027 Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 15:53:35.283073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5677770f291d42e493b4ef0dd346d049"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5677770f291d42e493b4ef0dd346d049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5677770f291d42e493b4ef0dd346d049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5677770f291d42e493b4ef0dd346d049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-VolumesGetTestJSON-464684027 Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 5677770f291d42e493b4ef0dd346d049 Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-VolumesGetTestJSON-464684027 Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-VolumesGetTestJSON-464684027-project Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: a93503cfdcad4ec2a40a4865a31270c0 Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-VolumesGetTestJSON-464684027-project Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Volume ea026e10-12f9-49cb-afae-d3b48858e29c could not be found. Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': 'ea026e10-12f9-49cb-afae-d3b48858e29c'} Jul 15 15:53:35.284282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea026e10-12f9-49cb-afae-d3b48858e29c could not be found. (HTTP 404) (Request-ID: req-8b755d26-f999-4ace-a316-67db0e18b2d9) Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:35.284898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:53:35.285933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea026e10-12f9-49cb-afae-d3b48858e29c could not be found. Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 15:53:35.288031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea026e10-12f9-49cb-afae-d3b48858e29c could not be found. Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea026e10-12f9-49cb-afae-d3b48858e29c could not be found. Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-359caaab-ba95-4119-8be9-0394a818fc23 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] Returning 404 to user: Volume ea026e10-12f9-49cb-afae-d3b48858e29c could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:53:35.289071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-359caaab-ba95-4119-8be9-0394a818fc23 tempest-VolumesGetTestJSON-464684027 tempest-VolumesGetTestJSON-464684027-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c" status: 404 len: 109 microversion: 2.1 time: 1.323475 Jul 15 15:53:35.291649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 23/45] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:33 2022] GET /compute/v2.1/os-volumes/ea026e10-12f9-49cb-afae-d3b48858e29c => generated 109 bytes in 1330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:53:35.308648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-24fe105f-a0be-4474-8c54-8c26431f9f70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:35.312725 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-24fe105f-a0be-4474-8c54-8c26431f9f70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:35.334404 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-24fe105f-a0be-4474-8c54-8c26431f9f70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:35.335978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-24fe105f-a0be-4474-8c54-8c26431f9f70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:35.340823 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-24fe105f-a0be-4474-8c54-8c26431f9f70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:35.341441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-24fe105f-a0be-4474-8c54-8c26431f9f70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:35.689809 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4e08c8ff-6aaa-47c1-b37e-9d25c25b2c71 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:35.710715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4e08c8ff-6aaa-47c1-b37e-9d25c25b2c71 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1275 microversion: 2.1 time: 0.518603 Jul 15 15:53:35.729826 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 23/46] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:35 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1275 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:35.751062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7ce1b296-29bd-4825-9c69-57dfabd2f0b7 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510ae0eaf0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:35.752231 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-24fe105f-a0be-4474-8c54-8c26431f9f70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:35.767963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-24fe105f-a0be-4474-8c54-8c26431f9f70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1277 microversion: 2.1 time: 0.467072 Jul 15 15:53:35.773326 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 24/47] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:35 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1277 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:35.844551 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7ce1b296-29bd-4825-9c69-57dfabd2f0b7 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 200 len: 344 microversion: 2.1 time: 0.113381 Jul 15 15:53:35.845004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 24/48] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:35 2022] GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 344 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:35.987100 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-304969160", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc60fd33-4bb2-4a5e-8f06-fbec56f3f79f"}], "security_groups": [{"name": "tempest-securitygroup--1308647292"}], "key_name": "tempest-keypair-17495743", "user_data": "}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:36.284082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] validate_networks() for [('bc60fd33-4bb2-4a5e-8f06-fbec56f3f79f', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:53:36.525984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-522995996", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a36e03ae-e414-4603-bddb-0fccaa84410d"}], "security_groups": [{"name": "tempest-securitygroup--473999816"}], "key_name": "tempest-keypair-508257415", "user_data": "}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:36.766359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] validate_networks() for [('a36e03ae-e414-4603-bddb-0fccaa84410d', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:53:37.525016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:53:37.531832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:53:37.531832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:53:37.531832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:53:37.531832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:53:37.553925 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:37.554389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:37.555176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:37.558145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:37.596590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Getting quotas for project 7df1ad577ddf4dc8a9a75ad1a1337ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:53:37.607140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Getting quotas for user ac8dfa5c97594e74a6839d91b292adcd and project 7df1ad577ddf4dc8a9a75ad1a1337ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:53:37.636205 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:53:37.638929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:53:37.756846 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:53:37.758684 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:53:37.759834 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:53:37.760435 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:53:37.761021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:53:37.773985 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:37.775071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:37.776464 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:37.777348 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:37.801123 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Getting quotas for project 93e4d5ff424c4e4fa5dd81c20cc920d0. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:53:37.806747 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Getting quotas for user 78db558bb3ea4161b4a54e62f9ec3bd6 and project 93e4d5ff424c4e4fa5dd81c20cc920d0. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:53:37.807264 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d082b3ee-f34e-487b-b68a-1534f91b1bda tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.831968 Jul 15 15:53:37.812580 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 25/49] 10.222.0.98 () {62 vars in 1187 bytes} [Fri Jul 15 15:53:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 15:53:37.826437 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:53:37.829427 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:53:37.832639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5e1d516e-ac35-4111-ac43-ce47abac8f31 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:37.833775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5e1d516e-ac35-4111-ac43-ce47abac8f31 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:37.843486 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e1d516e-ac35-4111-ac43-ce47abac8f31 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:37.844272 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e1d516e-ac35-4111-ac43-ce47abac8f31 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:37.845287 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e1d516e-ac35-4111-ac43-ce47abac8f31 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:37.845929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e1d516e-ac35-4111-ac43-ce47abac8f31 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:38.001590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5e1d516e-ac35-4111-ac43-ce47abac8f31 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:38.011225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5e1d516e-ac35-4111-ac43-ce47abac8f31 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1285 microversion: 2.1 time: 0.197217 Jul 15 15:53:38.012527 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 26/50] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:37 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:38.041799 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7e39ae6a-ea80-4a2d-a873-6e96752cbafc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:38.060758 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0a1470f7-b408-4edd-9701-aebd4ace3b45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.541764 Jul 15 15:53:38.063156 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 25/51] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:53:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:53:38.079673 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a51fc9ce-483c-49e8-a5cf-c59afe154828 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510ae0edc0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:38.081389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7e39ae6a-ea80-4a2d-a873-6e96752cbafc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:38.123020 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e39ae6a-ea80-4a2d-a873-6e96752cbafc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:38.123522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e39ae6a-ea80-4a2d-a873-6e96752cbafc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:38.124308 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e39ae6a-ea80-4a2d-a873-6e96752cbafc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:38.126263 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e39ae6a-ea80-4a2d-a873-6e96752cbafc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:38.253009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a51fc9ce-483c-49e8-a5cf-c59afe154828 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 200 len: 344 microversion: 2.1 time: 0.188474 Jul 15 15:53:38.254196 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 26/52] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:38 2022] GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:38.266649 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6f250b26-850f-45ca-8cbe-3e9a967caa00 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:38.267350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6f250b26-850f-45ca-8cbe-3e9a967caa00 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:38.401935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6f250b26-850f-45ca-8cbe-3e9a967caa00 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:38.411881 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6f250b26-850f-45ca-8cbe-3e9a967caa00 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:38.413413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6f250b26-850f-45ca-8cbe-3e9a967caa00 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:38.415408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6f250b26-850f-45ca-8cbe-3e9a967caa00 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1279 microversion: 2.20 time: 0.155025 Jul 15 15:53:38.416343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 27/53] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:38 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:38.421583 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-17a02084-8f14-4042-ae3b-5cb3c549f4bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:38.422380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-17a02084-8f14-4042-ae3b-5cb3c549f4bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:38.476018 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7e39ae6a-ea80-4a2d-a873-6e96752cbafc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:38.490075 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-17a02084-8f14-4042-ae3b-5cb3c549f4bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:38.497526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-17a02084-8f14-4042-ae3b-5cb3c549f4bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1236 microversion: 2.1 time: 0.079956 Jul 15 15:53:38.498114 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 28/54] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:38 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:38.506313 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7e39ae6a-ea80-4a2d-a873-6e96752cbafc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.480817 Jul 15 15:53:38.508151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 27/55] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:38 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:39.029822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-317ffcc5-629e-4350-8221-7c360c7fcfba tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:39.030996 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-317ffcc5-629e-4350-8221-7c360c7fcfba tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:39.037587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-317ffcc5-629e-4350-8221-7c360c7fcfba tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:39.038305 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-317ffcc5-629e-4350-8221-7c360c7fcfba tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:39.039269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-317ffcc5-629e-4350-8221-7c360c7fcfba tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:39.039964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-317ffcc5-629e-4350-8221-7c360c7fcfba tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:39.144759 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-317ffcc5-629e-4350-8221-7c360c7fcfba tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:39.177907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-317ffcc5-629e-4350-8221-7c360c7fcfba tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1285 microversion: 2.1 time: 0.152500 Jul 15 15:53:39.182373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 29/56] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:39 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:39.267703 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0ce5f1a1-9e2f-42ce-9ab7-f87abeac655c tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510adc59d0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:39.356170 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0ce5f1a1-9e2f-42ce-9ab7-f87abeac655c tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 200 len: 344 microversion: 2.1 time: 0.093697 Jul 15 15:53:39.358150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 28/57] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:39 2022] GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:53:39.433577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-86bf6059-7336-46e8-ab9e-9aa1f60806a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:39.437147 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-86bf6059-7336-46e8-ab9e-9aa1f60806a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:39.522311 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3d1944ab-921b-46f4-9b74-ebc03e3ead23 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:39.523180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3d1944ab-921b-46f4-9b74-ebc03e3ead23 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:39.646045 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3d1944ab-921b-46f4-9b74-ebc03e3ead23 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:39.664135 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3d1944ab-921b-46f4-9b74-ebc03e3ead23 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1236 microversion: 2.1 time: 0.146086 Jul 15 15:53:39.675326 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 29/58] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:39 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1236 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:39.690686 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5c238243-83be-4838-8286-f594588468ea tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:39.692709 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5c238243-83be-4838-8286-f594588468ea tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:39.721933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c238243-83be-4838-8286-f594588468ea tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:39.724850 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c238243-83be-4838-8286-f594588468ea tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:39.729284 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c238243-83be-4838-8286-f594588468ea tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:39.733626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c238243-83be-4838-8286-f594588468ea tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:39.740822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-86bf6059-7336-46e8-ab9e-9aa1f60806a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:39.749464 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-86bf6059-7336-46e8-ab9e-9aa1f60806a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:39.753692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-86bf6059-7336-46e8-ab9e-9aa1f60806a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:39.757486 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-86bf6059-7336-46e8-ab9e-9aa1f60806a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1279 microversion: 2.20 time: 0.327859 Jul 15 15:53:39.760674 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 30/59] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:39 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1279 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:39.960030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5c238243-83be-4838-8286-f594588468ea tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:39.975755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5c238243-83be-4838-8286-f594588468ea tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.303568 Jul 15 15:53:39.976825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 30/60] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:39 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:40.202153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-285524dc-4c1a-47b8-b2a1-edd243614140 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:40.202814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-285524dc-4c1a-47b8-b2a1-edd243614140 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:40.211067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-285524dc-4c1a-47b8-b2a1-edd243614140 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:40.212115 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-285524dc-4c1a-47b8-b2a1-edd243614140 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:40.213210 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-285524dc-4c1a-47b8-b2a1-edd243614140 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:40.213858 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-285524dc-4c1a-47b8-b2a1-edd243614140 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:40.312267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-285524dc-4c1a-47b8-b2a1-edd243614140 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:40.328869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-285524dc-4c1a-47b8-b2a1-edd243614140 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1273 microversion: 2.1 time: 0.132373 Jul 15 15:53:40.339001 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 31/61] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:40 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:40.369114 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8039e4bb-8257-45de-b3cd-32d6392a16e1 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510ad95f70>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:40.497968 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8039e4bb-8257-45de-b3cd-32d6392a16e1 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 200 len: 344 microversion: 2.1 time: 0.133185 Jul 15 15:53:40.498818 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 31/62] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:40 2022] GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:40.688158 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a03bbdea-6e66-4e7c-bb77-2128317fd843 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:40.689335 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a03bbdea-6e66-4e7c-bb77-2128317fd843 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:40.702702 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a03bbdea-6e66-4e7c-bb77-2128317fd843 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:40.703466 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a03bbdea-6e66-4e7c-bb77-2128317fd843 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:40.704636 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a03bbdea-6e66-4e7c-bb77-2128317fd843 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:40.705917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a03bbdea-6e66-4e7c-bb77-2128317fd843 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:40.776504 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:40.777134 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:40.786988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:40.790272 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:40.802140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:40.802140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:40.888056 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a03bbdea-6e66-4e7c-bb77-2128317fd843 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:40.904940 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a03bbdea-6e66-4e7c-bb77-2128317fd843 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1240 microversion: 2.1 time: 0.223893 Jul 15 15:53:40.920254 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 32/63] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:40 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1240 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:40.946597 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:40.955519 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:40.957021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:40.958151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bf7f712b-dbb5-48e6-9eb6-b216b14d1501 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1283 microversion: 2.20 time: 0.186059 Jul 15 15:53:40.971189 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 32/64] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:40 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:53:40.994408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-be8ef9eb-1551-43f7-9463-c820b70e582f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:40.995034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-be8ef9eb-1551-43f7-9463-c820b70e582f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:41.004706 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-be8ef9eb-1551-43f7-9463-c820b70e582f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:41.005172 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-be8ef9eb-1551-43f7-9463-c820b70e582f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:41.006013 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-be8ef9eb-1551-43f7-9463-c820b70e582f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:41.006464 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-be8ef9eb-1551-43f7-9463-c820b70e582f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:41.346683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-11018717-35c2-422a-8a8c-adb739d99dfe tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:41.347588 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-11018717-35c2-422a-8a8c-adb739d99dfe tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:41.390770 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11018717-35c2-422a-8a8c-adb739d99dfe tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:41.397838 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11018717-35c2-422a-8a8c-adb739d99dfe tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:41.397838 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11018717-35c2-422a-8a8c-adb739d99dfe tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:41.397838 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11018717-35c2-422a-8a8c-adb739d99dfe tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:41.605793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-be8ef9eb-1551-43f7-9463-c820b70e582f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:41.618413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-be8ef9eb-1551-43f7-9463-c820b70e582f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.627802 Jul 15 15:53:41.619483 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 33/65] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:40 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:41.624749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dbc4086f-f12e-482e-a873-ce0091740c81 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510ae1f790>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:41.908111 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-11018717-35c2-422a-8a8c-adb739d99dfe tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:41.941242 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-11018717-35c2-422a-8a8c-adb739d99dfe tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.598017 Jul 15 15:53:41.955228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 33/66] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:41 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:41.961489 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-59c23a3e-c5e3-4f03-94a7-818780d2d4f1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:41.962814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-59c23a3e-c5e3-4f03-94a7-818780d2d4f1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:41.984265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-59c23a3e-c5e3-4f03-94a7-818780d2d4f1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:41.984265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-59c23a3e-c5e3-4f03-94a7-818780d2d4f1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:41.991137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-59c23a3e-c5e3-4f03-94a7-818780d2d4f1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:41.993534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-59c23a3e-c5e3-4f03-94a7-818780d2d4f1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:42.172228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-59c23a3e-c5e3-4f03-94a7-818780d2d4f1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:42.184492 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-59c23a3e-c5e3-4f03-94a7-818780d2d4f1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1232 microversion: 2.1 time: 0.225651 Jul 15 15:53:42.186958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 34/67] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:41 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1232 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:42.198534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:42.203619 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:42.222667 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:42.224002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:42.224879 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:42.227672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:42.251359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-dbc4086f-f12e-482e-a873-ce0091740c81 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] HTTP exception thrown: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dbc4086f-f12e-482e-a873-ce0091740c81 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Request method failure captured: Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e HTTP/1.1 Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y1qUQLlzQyN1HfMCAQWG5l0lkOIBoO1B9hyzwx9h7V5rkjY5jPadhNcol0qj1PbiGDwjWp5yzYaknoTQpJjqqVTaKrlpOgnzJ0Q7JsCILpaDw7s5eH1zht51YQtA223ydCQUPR0_fG1Zq4gExr_wQfVngOQ8yGao-0uwU_gOSQMvf8 Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c5b5c3ebb2ec42988f6203ec34392dc6 Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:53:42.255547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c5b5c3ebb2ec42988f6203ec34392dc6 Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-VolumesSnapshotsTestJSON-196686007-project Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 2ff316f85f3e40178a0e7354a123e483 Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-VolumesSnapshotsTestJSON-196686007-project Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e'} Jul 15 15:53:42.256857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. (HTTP 404) (Request-ID: req-162ef83e-ff69-4aed-a7dc-e1b7705dbb83) Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.257613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:53:42.258693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 15:53:42.259813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.260827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.262606 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dbc4086f-f12e-482e-a873-ce0091740c81 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Returning 404 to user: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:53:42.263427 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dbc4086f-f12e-482e-a873-ce0091740c81 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 404 len: 109 microversion: 2.1 time: 0.642631 Jul 15 15:53:42.263980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 34/68] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:41 2022] GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 109 bytes in 644 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:53:42.287729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3af116de-ec5d-40b7-806a-2b4112dddf86 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510d2489d0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:42.391480 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:42.405074 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:42.405992 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:42.407481 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-78da5dda-b523-4c75-92f9-3a122c2184af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1331 microversion: 2.20 time: 0.219101 Jul 15 15:53:42.408353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 35/69] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:42 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1331 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:42.483700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-3af116de-ec5d-40b7-806a-2b4112dddf86 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] HTTP exception thrown: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3af116de-ec5d-40b7-806a-2b4112dddf86 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Request method failure captured: Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e HTTP/1.1 Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y1qUQLlzQyN1HfMCAQWG5l0lkOIBoO1B9hyzwx9h7V5rkjY5jPadhNcol0qj1PbiGDwjWp5yzYaknoTQpJjqqVTaKrlpOgnzJ0Q7JsCILpaDw7s5eH1zht51YQtA223ydCQUPR0_fG1Zq4gExr_wQfVngOQ8yGao-0uwU_gOSQMvf8 Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c5b5c3ebb2ec42988f6203ec34392dc6 Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:53:42.485923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c5b5c3ebb2ec42988f6203ec34392dc6 Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-VolumesSnapshotsTestJSON-196686007-project Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 2ff316f85f3e40178a0e7354a123e483 Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-VolumesSnapshotsTestJSON-196686007-project Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e'} Jul 15 15:53:42.487396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. (HTTP 404) (Request-ID: req-6ba4368f-63e4-49c6-9cc8-de0381d5d933) Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.488171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:53:42.489300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 15:53:42.490443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.491828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.493546 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3af116de-ec5d-40b7-806a-2b4112dddf86 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Returning 404 to user: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:53:42.494594 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3af116de-ec5d-40b7-806a-2b4112dddf86 tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 404 len: 109 microversion: 2.1 time: 0.219020 Jul 15 15:53:42.495167 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 35/70] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 15:53:42 2022] DELETE /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 109 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:53:42.505117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f0a3fbd2-cc14-4c54-a75b-7a3f2bf3c50b tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Calling method '.version_select at 0x7f510ad95ca0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:42.641239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-22ccd557-d75a-46eb-90b7-9622a0a60771 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:42.643496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-22ccd557-d75a-46eb-90b7-9622a0a60771 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:42.689504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-22ccd557-d75a-46eb-90b7-9622a0a60771 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:42.689504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-22ccd557-d75a-46eb-90b7-9622a0a60771 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:42.689504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-22ccd557-d75a-46eb-90b7-9622a0a60771 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:42.689504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-22ccd557-d75a-46eb-90b7-9622a0a60771 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:42.822710 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-f0a3fbd2-cc14-4c54-a75b-7a3f2bf3c50b tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] HTTP exception thrown: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f0a3fbd2-cc14-4c54-a75b-7a3f2bf3c50b tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Request method failure captured: Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e HTTP/1.1 Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y1qUQLlzQyN1HfMCAQWG5l0lkOIBoO1B9hyzwx9h7V5rkjY5jPadhNcol0qj1PbiGDwjWp5yzYaknoTQpJjqqVTaKrlpOgnzJ0Q7JsCILpaDw7s5eH1zht51YQtA223ydCQUPR0_fG1Zq4gExr_wQfVngOQ8yGao-0uwU_gOSQMvf8 Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: c5b5c3ebb2ec42988f6203ec34392dc6 Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 15:53:42.823616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c5b5c3ebb2ec42988f6203ec34392dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: c5b5c3ebb2ec42988f6203ec34392dc6 Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-196686007 Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-VolumesSnapshotsTestJSON-196686007-project Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 2ff316f85f3e40178a0e7354a123e483 Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-VolumesSnapshotsTestJSON-196686007-project Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e'} Jul 15 15:53:42.824771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. (HTTP 404) (Request-ID: req-1b4bf2fd-13ca-49fa-8719-1deb025a3c9f) Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.825681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:53:42.826574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 15:53:42.827525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:53:42.830795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f0a3fbd2-cc14-4c54-a75b-7a3f2bf3c50b tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] Returning 404 to user: Volume 2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:53:42.832112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f0a3fbd2-cc14-4c54-a75b-7a3f2bf3c50b tempest-VolumesSnapshotsTestJSON-196686007 tempest-VolumesSnapshotsTestJSON-196686007-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e" status: 404 len: 109 microversion: 2.1 time: 0.331369 Jul 15 15:53:42.836931 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 36/71] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:42 2022] GET /compute/v2.1/os-volumes/2e18f75c-5499-43ab-bbbd-fc2e1e50fe1e => generated 109 bytes in 337 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:53:42.961064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ede95c7c-3cb5-4d54-9c5c-4ebc8742f4c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:42.963080 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ede95c7c-3cb5-4d54-9c5c-4ebc8742f4c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:42.979360 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ede95c7c-3cb5-4d54-9c5c-4ebc8742f4c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:42.980155 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ede95c7c-3cb5-4d54-9c5c-4ebc8742f4c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:42.992230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ede95c7c-3cb5-4d54-9c5c-4ebc8742f4c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:42.993082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ede95c7c-3cb5-4d54-9c5c-4ebc8742f4c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:43.279052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-22ccd557-d75a-46eb-90b7-9622a0a60771 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:43.293052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-22ccd557-d75a-46eb-90b7-9622a0a60771 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.658872 Jul 15 15:53:43.293712 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 36/72] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:42 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:43.304684 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-97313342-3f5a-4db3-b545-e9e8ed8eac90 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:43.309591 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-97313342-3f5a-4db3-b545-e9e8ed8eac90 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:43.321932 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97313342-3f5a-4db3-b545-e9e8ed8eac90 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:43.325440 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97313342-3f5a-4db3-b545-e9e8ed8eac90 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:43.326490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97313342-3f5a-4db3-b545-e9e8ed8eac90 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:43.327166 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97313342-3f5a-4db3-b545-e9e8ed8eac90 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:43.483086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ede95c7c-3cb5-4d54-9c5c-4ebc8742f4c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:43.487793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-97313342-3f5a-4db3-b545-e9e8ed8eac90 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:43.494228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ede95c7c-3cb5-4d54-9c5c-4ebc8742f4c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.537826 Jul 15 15:53:43.495320 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 37/73] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:42 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:43.498275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-97313342-3f5a-4db3-b545-e9e8ed8eac90 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1288 microversion: 2.1 time: 0.201688 Jul 15 15:53:43.500785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:43.500918 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 37/74] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:43 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1288 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:43.501752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:43.532125 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:43.532655 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:43.533705 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:43.534384 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:43.676391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:43.692306 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:43.694854 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:43.696765 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ae9e0b4c-aa7c-497e-8d34-e951306b6dc7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1331 microversion: 2.20 time: 0.200213 Jul 15 15:53:43.698211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 38/75] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:43 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1331 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:44.310387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0d88f976-530a-4fd9-800c-feeb92a33669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:44.311007 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0d88f976-530a-4fd9-800c-feeb92a33669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:44.333049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0d88f976-530a-4fd9-800c-feeb92a33669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:44.333497 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0d88f976-530a-4fd9-800c-feeb92a33669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:44.334282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0d88f976-530a-4fd9-800c-feeb92a33669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:44.334724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0d88f976-530a-4fd9-800c-feeb92a33669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:44.517934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-482fc0b2-ab3f-40f1-8aa1-180597af707e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:44.518703 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-482fc0b2-ab3f-40f1-8aa1-180597af707e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:44.551237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-482fc0b2-ab3f-40f1-8aa1-180597af707e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:44.552039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-482fc0b2-ab3f-40f1-8aa1-180597af707e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:44.552883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-482fc0b2-ab3f-40f1-8aa1-180597af707e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:44.553323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-482fc0b2-ab3f-40f1-8aa1-180597af707e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:44.816510 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-482fc0b2-ab3f-40f1-8aa1-180597af707e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:44.818403 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0d88f976-530a-4fd9-800c-feeb92a33669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:44.826351 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-482fc0b2-ab3f-40f1-8aa1-180597af707e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.311530 Jul 15 15:53:44.836332 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 39/76] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:44 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:44.838179 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0d88f976-530a-4fd9-800c-feeb92a33669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.531854 Jul 15 15:53:44.838972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 38/77] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:44 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:44.841021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-970c19d6-26f9-4da9-92ce-1cf949159fe6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:44.841978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-970c19d6-26f9-4da9-92ce-1cf949159fe6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:44.845110 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:44.853778 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-970c19d6-26f9-4da9-92ce-1cf949159fe6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:44.853778 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-970c19d6-26f9-4da9-92ce-1cf949159fe6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:44.853989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:44.854065 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-970c19d6-26f9-4da9-92ce-1cf949159fe6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:44.854132 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:44.854197 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-970c19d6-26f9-4da9-92ce-1cf949159fe6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:44.858575 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:44.859039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:44.859863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:44.860481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:44.971178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-970c19d6-26f9-4da9-92ce-1cf949159fe6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:44.992821 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:44.994912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-970c19d6-26f9-4da9-92ce-1cf949159fe6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1288 microversion: 2.1 time: 0.165617 Jul 15 15:53:44.995981 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 40/78] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:44 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1288 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:45.009662 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:45.013900 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:45.018643 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0965242a-7829-4ad3-890b-c03373d00e09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1339 microversion: 2.20 time: 0.176152 Jul 15 15:53:45.019799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 39/79] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:44 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1339 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:45.844281 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f167f282-8c43-4f41-95ea-717c93829442 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:45.851163 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f167f282-8c43-4f41-95ea-717c93829442 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:45.871644 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f167f282-8c43-4f41-95ea-717c93829442 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:45.877399 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f167f282-8c43-4f41-95ea-717c93829442 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:45.879656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f167f282-8c43-4f41-95ea-717c93829442 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:45.882741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f167f282-8c43-4f41-95ea-717c93829442 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:45.896869 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-9d4378ad-adf1-4a2f-8b11-4c984dc5618b req-757c094f-f50d-4b13-9db7-2ab82c9664a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5", "tag": "e7800a16-36db-4bcb-be6d-391c82f24f64"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:45.931100 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-9d4378ad-adf1-4a2f-8b11-4c984dc5618b req-757c094f-f50d-4b13-9db7-2ab82c9664a6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:45.933202 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-9d4378ad-adf1-4a2f-8b11-4c984dc5618b req-757c094f-f50d-4b13-9db7-2ab82c9664a6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:45.988146 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-9d4378ad-adf1-4a2f-8b11-4c984dc5618b req-757c094f-f50d-4b13-9db7-2ab82c9664a6 service nova] Creating event network-changed:e7800a16-36db-4bcb-be6d-391c82f24f64 for instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 on hv-cinder-83587 Jul 15 15:53:45.989089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-9d4378ad-adf1-4a2f-8b11-4c984dc5618b req-757c094f-f50d-4b13-9db7-2ab82c9664a6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130090) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 15:53:45.990813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89dafa02-d064-46f0-97ad-9eea2c4dc84f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:45.991672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89dafa02-d064-46f0-97ad-9eea2c4dc84f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:45.992877 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89dafa02-d064-46f0-97ad-9eea2c4dc84f None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:45.993589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89dafa02-d064-46f0-97ad-9eea2c4dc84f None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:46.008431 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.compute.rpcapi [None req-89dafa02-d064-46f0-97ad-9eea2c4dc84f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 15:53:46.009755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89dafa02-d064-46f0-97ad-9eea2c4dc84f None None] Releasing lock "compute-rpcapi-router" {{(pid=130090) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 15:53:46.041448 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-89dafa02-d064-46f0-97ad-9eea2c4dc84f None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352632 Jul 15 15:53:46.042996 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 41/80] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:46.053420 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2d075001-2449-4679-a595-0c2dd6311773 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:46.054400 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2d075001-2449-4679-a595-0c2dd6311773 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:46.064731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d075001-2449-4679-a595-0c2dd6311773 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:46.065243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d075001-2449-4679-a595-0c2dd6311773 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:46.068104 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d075001-2449-4679-a595-0c2dd6311773 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:46.068104 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d075001-2449-4679-a595-0c2dd6311773 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:46.283473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2d075001-2449-4679-a595-0c2dd6311773 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:46.293614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2d075001-2449-4679-a595-0c2dd6311773 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.248461 Jul 15 15:53:46.296301 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 42/81] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:46 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:46.311386 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-464ec04a-204d-4472-be45-788571b38d94 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:46.312270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-464ec04a-204d-4472-be45-788571b38d94 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:46.329242 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-464ec04a-204d-4472-be45-788571b38d94 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:46.337577 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-464ec04a-204d-4472-be45-788571b38d94 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:46.338413 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-464ec04a-204d-4472-be45-788571b38d94 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:46.338853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-464ec04a-204d-4472-be45-788571b38d94 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:46.891519 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f167f282-8c43-4f41-95ea-717c93829442 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:46.901036 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f167f282-8c43-4f41-95ea-717c93829442 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 1.060741 Jul 15 15:53:46.911259 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 40/82] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:45 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:46.915777 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:46.920598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:46.930915 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-464ec04a-204d-4472-be45-788571b38d94 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:46.934030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:46.936938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:46.937127 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:46.937968 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:46.938413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:46.953301 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-464ec04a-204d-4472-be45-788571b38d94 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1296 microversion: 2.1 time: 0.653152 Jul 15 15:53:46.956460 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 43/83] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:46 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1296 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:47.202476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:47.214819 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:47.216358 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:47.217470 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b1c309ea-2faa-4d80-81c0-37ccf0177029 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1337 microversion: 2.20 time: 0.307953 Jul 15 15:53:47.218199 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 41/84] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:46 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1337 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:47.312781 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d83652e3-10f2-43e8-bf68-61a271ae6628 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:47.313394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d83652e3-10f2-43e8-bf68-61a271ae6628 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:47.319967 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d83652e3-10f2-43e8-bf68-61a271ae6628 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:47.320894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d83652e3-10f2-43e8-bf68-61a271ae6628 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:47.321924 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d83652e3-10f2-43e8-bf68-61a271ae6628 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:47.322502 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d83652e3-10f2-43e8-bf68-61a271ae6628 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:47.527860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d83652e3-10f2-43e8-bf68-61a271ae6628 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:47.536920 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d83652e3-10f2-43e8-bf68-61a271ae6628 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.228764 Jul 15 15:53:47.538004 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 44/85] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:47 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:47.926060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f6f64ec0-1513-4f23-85f7-b23994badc63 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:47.927953 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f6f64ec0-1513-4f23-85f7-b23994badc63 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:47.930148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=4 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:47.937034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f6f64ec0-1513-4f23-85f7-b23994badc63 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:47.937755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f6f64ec0-1513-4f23-85f7-b23994badc63 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:47.938693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f6f64ec0-1513-4f23-85f7-b23994badc63 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:47.939277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f6f64ec0-1513-4f23-85f7-b23994badc63 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:47.975659 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-efec1a2b-c429-4056-a34e-bf1a6bc5cbbb tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:47.977012 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-efec1a2b-c429-4056-a34e-bf1a6bc5cbbb tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:47.993076 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efec1a2b-c429-4056-a34e-bf1a6bc5cbbb tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:47.994872 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efec1a2b-c429-4056-a34e-bf1a6bc5cbbb tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:47.997036 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efec1a2b-c429-4056-a34e-bf1a6bc5cbbb tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:47.997773 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efec1a2b-c429-4056-a34e-bf1a6bc5cbbb tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:48.168086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-efec1a2b-c429-4056-a34e-bf1a6bc5cbbb tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:48.177460 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-efec1a2b-c429-4056-a34e-bf1a6bc5cbbb tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1306 microversion: 2.1 time: 0.206585 Jul 15 15:53:48.180598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 45/86] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:47 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1306 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:48.199223 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-7a418d6f-8920-47a1-a94d-d68b29fed1ef req-684ecea8-f2b2-4850-a8e9-239d9f22951b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3687d5cd-925a-43c4-a87e-a36664f4a2c1", "tag": "d3d2d474-04a0-4618-89b1-cf1ca09b1df1"}, {"name": "network-changed", "server_uuid": "340a548f-e53b-443d-a606-fefe96076882", "tag": "cc489b1f-e51c-4189-a789-13fa2d662f4f"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:48.236765 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-7a418d6f-8920-47a1-a94d-d68b29fed1ef req-684ecea8-f2b2-4850-a8e9-239d9f22951b service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:48.237153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f6f64ec0-1513-4f23-85f7-b23994badc63 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:48.237942 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-7a418d6f-8920-47a1-a94d-d68b29fed1ef req-684ecea8-f2b2-4850-a8e9-239d9f22951b service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:48.247373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f6f64ec0-1513-4f23-85f7-b23994badc63 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.325048 Jul 15 15:53:48.247970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 42/87] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:47 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:48.272216 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:48.272839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:48.273602 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-7a418d6f-8920-47a1-a94d-d68b29fed1ef req-684ecea8-f2b2-4850-a8e9-239d9f22951b service nova] Creating event network-changed:d3d2d474-04a0-4618-89b1-cf1ca09b1df1 for instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 on hv-cinder-83587 Jul 15 15:53:48.274145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-7a418d6f-8920-47a1-a94d-d68b29fed1ef req-684ecea8-f2b2-4850-a8e9-239d9f22951b service nova] Creating event network-changed:cc489b1f-e51c-4189-a789-13fa2d662f4f for instance 340a548f-e53b-443d-a606-fefe96076882 on hv-cinder-83587 Jul 15 15:53:48.295907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:48.296364 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:48.297167 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:48.299067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:48.302799 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-7a418d6f-8920-47a1-a94d-d68b29fed1ef req-684ecea8-f2b2-4850-a8e9-239d9f22951b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118208 Jul 15 15:53:48.304895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 46/88] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:48.540843 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:48.549872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:48.551766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:48.552785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5e32cd0f-1670-4850-b25b-6e60020a0cf5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.284473 Jul 15 15:53:48.553582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 43/89] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:48 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:48.555066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3d9f075d-a319-44ca-a6ef-38ce010fcf4e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:48.555803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3d9f075d-a319-44ca-a6ef-38ce010fcf4e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:48.563658 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d9f075d-a319-44ca-a6ef-38ce010fcf4e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:48.564116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d9f075d-a319-44ca-a6ef-38ce010fcf4e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:48.564891 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d9f075d-a319-44ca-a6ef-38ce010fcf4e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:48.565329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d9f075d-a319-44ca-a6ef-38ce010fcf4e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:48.697069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3d9f075d-a319-44ca-a6ef-38ce010fcf4e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:48.705189 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3d9f075d-a319-44ca-a6ef-38ce010fcf4e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.154850 Jul 15 15:53:48.705757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 47/90] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:48 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:49.195570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-222f67a8-ceb6-4d7f-81da-68df5a794078 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:49.196192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-222f67a8-ceb6-4d7f-81da-68df5a794078 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:49.202784 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-222f67a8-ceb6-4d7f-81da-68df5a794078 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:49.203073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-222f67a8-ceb6-4d7f-81da-68df5a794078 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:49.203898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-222f67a8-ceb6-4d7f-81da-68df5a794078 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:49.204339 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-222f67a8-ceb6-4d7f-81da-68df5a794078 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:49.264038 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9308e328-cfb4-4a10-873c-fdea46bd7f3e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:49.264777 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9308e328-cfb4-4a10-873c-fdea46bd7f3e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:49.268685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-222f67a8-ceb6-4d7f-81da-68df5a794078 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:49.270868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9308e328-cfb4-4a10-873c-fdea46bd7f3e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:49.271352 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9308e328-cfb4-4a10-873c-fdea46bd7f3e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:49.272153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:49.272283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9308e328-cfb4-4a10-873c-fdea46bd7f3e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:49.272607 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9308e328-cfb4-4a10-873c-fdea46bd7f3e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:49.276531 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-222f67a8-ceb6-4d7f-81da-68df5a794078 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1306 microversion: 2.1 time: 0.084729 Jul 15 15:53:49.277143 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 44/91] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:49 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:49.418329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9308e328-cfb4-4a10-873c-fdea46bd7f3e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:49.426926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9308e328-cfb4-4a10-873c-fdea46bd7f3e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.166698 Jul 15 15:53:49.427558 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 48/92] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:49 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:49.572174 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:49.572788 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:49.575829 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:49.579420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:49.579882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:49.582581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:49.582581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:49.724079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-52bcb186-7210-4ff2-bc2c-2a41a3870cfa tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:49.724813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-52bcb186-7210-4ff2-bc2c-2a41a3870cfa tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:49.728661 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=28 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:49.735271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-52bcb186-7210-4ff2-bc2c-2a41a3870cfa tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:49.736809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-52bcb186-7210-4ff2-bc2c-2a41a3870cfa tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:49.737770 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-52bcb186-7210-4ff2-bc2c-2a41a3870cfa tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:49.738309 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-52bcb186-7210-4ff2-bc2c-2a41a3870cfa tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:49.748280 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=26 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:49.751724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:49.766056 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:49.767597 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:49.768711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-97c85ceb-dc51-4814-b8cd-29c24ca3b0fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.200964 Jul 15 15:53:49.769276 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 45/93] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:49 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:53:49.885158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-52bcb186-7210-4ff2-bc2c-2a41a3870cfa tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:49.910076 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-52bcb186-7210-4ff2-bc2c-2a41a3870cfa tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.190543 Jul 15 15:53:49.910586 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 49/94] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:49 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:50.295431 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4b0920fc-3e0c-4fe3-8eb6-27efdaf838e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:50.296417 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4b0920fc-3e0c-4fe3-8eb6-27efdaf838e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:50.303712 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4b0920fc-3e0c-4fe3-8eb6-27efdaf838e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:50.304162 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4b0920fc-3e0c-4fe3-8eb6-27efdaf838e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:50.304980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4b0920fc-3e0c-4fe3-8eb6-27efdaf838e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:50.305422 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4b0920fc-3e0c-4fe3-8eb6-27efdaf838e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:50.367873 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4b0920fc-3e0c-4fe3-8eb6-27efdaf838e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:50.375610 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4b0920fc-3e0c-4fe3-8eb6-27efdaf838e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1306 microversion: 2.1 time: 0.085280 Jul 15 15:53:50.376175 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 46/95] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:50 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1306 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:50.444707 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b3aeed76-b835-464c-92c3-cba44355080d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:50.445379 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b3aeed76-b835-464c-92c3-cba44355080d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:50.457448 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b3aeed76-b835-464c-92c3-cba44355080d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:50.457966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b3aeed76-b835-464c-92c3-cba44355080d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:50.461670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b3aeed76-b835-464c-92c3-cba44355080d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:50.461670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b3aeed76-b835-464c-92c3-cba44355080d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:50.654741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b3aeed76-b835-464c-92c3-cba44355080d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:50.672106 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b3aeed76-b835-464c-92c3-cba44355080d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.231611 Jul 15 15:53:50.672702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 50/96] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:50 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:50.787435 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:50.788052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:50.795655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:50.796109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:50.796888 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:50.797339 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:50.928612 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-754a6205-7889-4f60-8c87-4bb388d8332b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:50.929255 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-754a6205-7889-4f60-8c87-4bb388d8332b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:50.932271 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:50.938457 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-754a6205-7889-4f60-8c87-4bb388d8332b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:50.938911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-754a6205-7889-4f60-8c87-4bb388d8332b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:50.939720 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-754a6205-7889-4f60-8c87-4bb388d8332b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:50.940156 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-754a6205-7889-4f60-8c87-4bb388d8332b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:50.941448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:50.943169 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:50.945490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-869a2417-0700-4ebb-8796-c511b00a52b2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.160744 Jul 15 15:53:50.945490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 47/97] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:50 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:51.079158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-754a6205-7889-4f60-8c87-4bb388d8332b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:51.087071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-754a6205-7889-4f60-8c87-4bb388d8332b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.164450 Jul 15 15:53:51.087995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 51/98] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:50 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:51.397295 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-02a8c28d-306e-4e9e-8d41-be22e0dbc7bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:51.397295 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-02a8c28d-306e-4e9e-8d41-be22e0dbc7bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:51.401789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02a8c28d-306e-4e9e-8d41-be22e0dbc7bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:51.402274 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02a8c28d-306e-4e9e-8d41-be22e0dbc7bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:51.403353 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02a8c28d-306e-4e9e-8d41-be22e0dbc7bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:51.403797 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02a8c28d-306e-4e9e-8d41-be22e0dbc7bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:51.465330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-02a8c28d-306e-4e9e-8d41-be22e0dbc7bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:51.473247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-02a8c28d-306e-4e9e-8d41-be22e0dbc7bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1306 microversion: 2.1 time: 0.082554 Jul 15 15:53:51.473811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 48/99] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:51 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1306 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:51.689120 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e2752dc7-9f5b-4251-a879-34f499e25ddd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:51.689811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e2752dc7-9f5b-4251-a879-34f499e25ddd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:51.696340 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e2752dc7-9f5b-4251-a879-34f499e25ddd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:51.696828 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e2752dc7-9f5b-4251-a879-34f499e25ddd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:51.697637 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e2752dc7-9f5b-4251-a879-34f499e25ddd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:51.698077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e2752dc7-9f5b-4251-a879-34f499e25ddd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:51.829459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e2752dc7-9f5b-4251-a879-34f499e25ddd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:51.836901 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e2752dc7-9f5b-4251-a879-34f499e25ddd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.151628 Jul 15 15:53:51.837727 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 52/100] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:51 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:51.962073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:51.962790 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:51.970028 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:51.970482 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:51.971252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:51.973188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:52.104394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b4d725d7-9433-4511-a928-5b9b973df669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:52.105022 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b4d725d7-9433-4511-a928-5b9b973df669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:52.112868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b4d725d7-9433-4511-a928-5b9b973df669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:52.113325 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b4d725d7-9433-4511-a928-5b9b973df669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:52.114110 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b4d725d7-9433-4511-a928-5b9b973df669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:52.114551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b4d725d7-9433-4511-a928-5b9b973df669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:52.115717 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:52.126817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:52.129648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:52.129648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-02b75fb5-666c-4f03-adc4-6036b077ae0e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.171504 Jul 15 15:53:52.130284 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 49/101] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:51 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:52.253027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b4d725d7-9433-4511-a928-5b9b973df669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:52.261236 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b4d725d7-9433-4511-a928-5b9b973df669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.160690 Jul 15 15:53:52.261862 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 53/102] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:52 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:52.490005 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-30a7d5ba-f812-47fb-9ed0-7346e4c94540 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:52.490653 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-30a7d5ba-f812-47fb-9ed0-7346e4c94540 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:52.496637 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-30a7d5ba-f812-47fb-9ed0-7346e4c94540 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:52.497658 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-30a7d5ba-f812-47fb-9ed0-7346e4c94540 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:52.498445 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-30a7d5ba-f812-47fb-9ed0-7346e4c94540 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:52.498884 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-30a7d5ba-f812-47fb-9ed0-7346e4c94540 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:52.558556 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-30a7d5ba-f812-47fb-9ed0-7346e4c94540 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:52.566731 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-30a7d5ba-f812-47fb-9ed0-7346e4c94540 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1306 microversion: 2.1 time: 0.080429 Jul 15 15:53:52.567228 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 50/103] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:52 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1306 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:52.854015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-42f313c2-23f0-4016-ae93-8b32ef2636ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:52.854666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-42f313c2-23f0-4016-ae93-8b32ef2636ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:52.861575 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-42f313c2-23f0-4016-ae93-8b32ef2636ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:52.862185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-42f313c2-23f0-4016-ae93-8b32ef2636ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:52.862977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-42f313c2-23f0-4016-ae93-8b32ef2636ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:52.863440 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-42f313c2-23f0-4016-ae93-8b32ef2636ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:53.006158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-42f313c2-23f0-4016-ae93-8b32ef2636ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:53.014086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-42f313c2-23f0-4016-ae93-8b32ef2636ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.164059 Jul 15 15:53:53.014657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 54/104] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:52 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:53.148567 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:53.149185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:53.156095 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:53.156555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:53.157349 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:53.157773 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:53.278225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0bb5c3a3-ba54-42fb-8aef-fc3ac5a72ea7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:53.279729 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0bb5c3a3-ba54-42fb-8aef-fc3ac5a72ea7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:53.287729 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0bb5c3a3-ba54-42fb-8aef-fc3ac5a72ea7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:53.288488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0bb5c3a3-ba54-42fb-8aef-fc3ac5a72ea7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:53.289665 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0bb5c3a3-ba54-42fb-8aef-fc3ac5a72ea7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:53.290268 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0bb5c3a3-ba54-42fb-8aef-fc3ac5a72ea7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:53.295747 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:53.304297 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:53.306429 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:53.307389 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7713ad51-5640-43ac-acb3-9c6458aa29df tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.163197 Jul 15 15:53:53.310453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 51/105] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:53 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:53.464634 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0bb5c3a3-ba54-42fb-8aef-fc3ac5a72ea7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:53.474405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0bb5c3a3-ba54-42fb-8aef-fc3ac5a72ea7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.199668 Jul 15 15:53:53.475527 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 55/106] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:53 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:53.583659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f45e4b17-a427-4479-ba43-042e3ef3ae2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:53.584450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f45e4b17-a427-4479-ba43-042e3ef3ae2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:53.599361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f45e4b17-a427-4479-ba43-042e3ef3ae2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:53.599361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f45e4b17-a427-4479-ba43-042e3ef3ae2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:53.599361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f45e4b17-a427-4479-ba43-042e3ef3ae2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:53.599361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f45e4b17-a427-4479-ba43-042e3ef3ae2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:53.968901 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f45e4b17-a427-4479-ba43-042e3ef3ae2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:53.979167 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f45e4b17-a427-4479-ba43-042e3ef3ae2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1306 microversion: 2.1 time: 0.399457 Jul 15 15:53:53.981262 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 52/107] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:53 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1306 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:54.033683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-200d5517-7c8e-4e24-ba0b-302a6a386003 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:54.035054 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-200d5517-7c8e-4e24-ba0b-302a6a386003 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:54.042829 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-200d5517-7c8e-4e24-ba0b-302a6a386003 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:54.043759 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-200d5517-7c8e-4e24-ba0b-302a6a386003 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:54.045320 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-200d5517-7c8e-4e24-ba0b-302a6a386003 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:54.046024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-200d5517-7c8e-4e24-ba0b-302a6a386003 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:54.268260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-200d5517-7c8e-4e24-ba0b-302a6a386003 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:54.282488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-200d5517-7c8e-4e24-ba0b-302a6a386003 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.250004 Jul 15 15:53:54.282488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 56/108] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:54 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:54.336137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:54.336838 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:54.344111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:54.344628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:54.345818 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:54.346387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:54.492368 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e5796208-7b6b-4ba0-8b01-4478eb12050c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:54.492983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e5796208-7b6b-4ba0-8b01-4478eb12050c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:54.499965 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5796208-7b6b-4ba0-8b01-4478eb12050c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:54.500848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5796208-7b6b-4ba0-8b01-4478eb12050c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:54.501857 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5796208-7b6b-4ba0-8b01-4478eb12050c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:54.502439 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5796208-7b6b-4ba0-8b01-4478eb12050c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:54.639206 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e5796208-7b6b-4ba0-8b01-4478eb12050c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:54.649813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e5796208-7b6b-4ba0-8b01-4478eb12050c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.161731 Jul 15 15:53:54.650412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 57/109] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:54 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:54.664590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ed2ba0ef-14fb-4a9c-af5a-630d870b4e56 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ad210d0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:54.714478 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ed2ba0ef-14fb-4a9c-af5a-630d870b4e56 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/bcbefad6-f843-492c-8168-85be021132a7" status: 200 len: 350 microversion: 2.1 time: 0.053698 Jul 15 15:53:54.715069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 58/110] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:53:54 2022] GET /compute/v2.1/os-volumes/bcbefad6-f843-492c-8168-85be021132a7 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:54.739865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:54.752949 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:54.755126 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:54.756957 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0dc9dc8f-3fe8-4879-a85e-d657f7ebdd24 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.423993 Jul 15 15:53:54.758201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 53/111] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:54 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:55.004570 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-086994b8-7466-4473-80a9-6fc3a1e55efc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:55.005199 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-086994b8-7466-4473-80a9-6fc3a1e55efc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:55.012449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-086994b8-7466-4473-80a9-6fc3a1e55efc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.013528 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-086994b8-7466-4473-80a9-6fc3a1e55efc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.014381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-086994b8-7466-4473-80a9-6fc3a1e55efc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.015106 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-086994b8-7466-4473-80a9-6fc3a1e55efc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.101824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-086994b8-7466-4473-80a9-6fc3a1e55efc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:55.110646 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-086994b8-7466-4473-80a9-6fc3a1e55efc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1294 microversion: 2.1 time: 0.116613 Jul 15 15:53:55.111560 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 59/112] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:54 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:55.297143 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-eb6dc8df-c467-4a5e-ad9d-c78d5bc6ac13 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:55.297928 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-eb6dc8df-c467-4a5e-ad9d-c78d5bc6ac13 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:55.308454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eb6dc8df-c467-4a5e-ad9d-c78d5bc6ac13 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.308804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eb6dc8df-c467-4a5e-ad9d-c78d5bc6ac13 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.309698 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eb6dc8df-c467-4a5e-ad9d-c78d5bc6ac13 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.311672 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eb6dc8df-c467-4a5e-ad9d-c78d5bc6ac13 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.462782 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-407e12e4-97ba-47be-9424-23654a2e9cd5 req-b87159f1-091f-4aad-855f-39c09abb75bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652ce721-72c7-4314-8f15-bf94f30df443", "tag": "7734477d-4e1a-41e3-bb36-a23f41ac66aa"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:55.477183 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-407e12e4-97ba-47be-9424-23654a2e9cd5 req-b87159f1-091f-4aad-855f-39c09abb75bc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.477636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-407e12e4-97ba-47be-9424-23654a2e9cd5 req-b87159f1-091f-4aad-855f-39c09abb75bc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.495470 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-407e12e4-97ba-47be-9424-23654a2e9cd5 req-b87159f1-091f-4aad-855f-39c09abb75bc service nova] Creating event network-changed:7734477d-4e1a-41e3-bb36-a23f41ac66aa for instance 652ce721-72c7-4314-8f15-bf94f30df443 on hv-cinder-83587 Jul 15 15:53:55.502557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-407e12e4-97ba-47be-9424-23654a2e9cd5 req-b87159f1-091f-4aad-855f-39c09abb75bc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045906 Jul 15 15:53:55.503614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 60/113] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:55.555220 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eb6dc8df-c467-4a5e-ad9d-c78d5bc6ac13 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:55.564041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-eb6dc8df-c467-4a5e-ad9d-c78d5bc6ac13 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.271559 Jul 15 15:53:55.564710 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 54/114] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:55 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:55.667705 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-38afbee7-d99c-4589-a26e-c391f778764b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:55.675675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-38afbee7-d99c-4589-a26e-c391f778764b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:55.677260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38afbee7-d99c-4589-a26e-c391f778764b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.677983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38afbee7-d99c-4589-a26e-c391f778764b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.679479 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38afbee7-d99c-4589-a26e-c391f778764b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.680066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38afbee7-d99c-4589-a26e-c391f778764b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.787243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:55.787243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:55.797332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.799975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.801277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:55.801745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:55.839225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-38afbee7-d99c-4589-a26e-c391f778764b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:55.847379 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-38afbee7-d99c-4589-a26e-c391f778764b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.183879 Jul 15 15:53:55.847984 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 61/115] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:55 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:55.940496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:55.948629 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:55.950135 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:55.951446 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-603a3b7e-9fe8-43d3-8820-efe2c01f1e94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.179971 Jul 15 15:53:55.951823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 55/116] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:55 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:53:56.128857 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cc4fd40c-cfae-486e-9553-871963b2709b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:56.129482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cc4fd40c-cfae-486e-9553-871963b2709b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:56.134730 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=8 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:56.136732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cc4fd40c-cfae-486e-9553-871963b2709b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:56.137267 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cc4fd40c-cfae-486e-9553-871963b2709b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:56.138734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cc4fd40c-cfae-486e-9553-871963b2709b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:56.139211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cc4fd40c-cfae-486e-9553-871963b2709b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:56.278226 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cc4fd40c-cfae-486e-9553-871963b2709b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:56.282338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:56.286805 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cc4fd40c-cfae-486e-9553-871963b2709b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.163360 Jul 15 15:53:56.287699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 62/117] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:56 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:56.582124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d825f4cf-09d4-47d6-8cfe-ece561177915 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:56.582700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d825f4cf-09d4-47d6-8cfe-ece561177915 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:56.589159 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d825f4cf-09d4-47d6-8cfe-ece561177915 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:56.589875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d825f4cf-09d4-47d6-8cfe-ece561177915 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:56.590739 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d825f4cf-09d4-47d6-8cfe-ece561177915 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:56.591202 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d825f4cf-09d4-47d6-8cfe-ece561177915 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:56.735280 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d825f4cf-09d4-47d6-8cfe-ece561177915 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:56.744436 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d825f4cf-09d4-47d6-8cfe-ece561177915 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.166198 Jul 15 15:53:56.751377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 56/118] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:56 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:53:56.868008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-74b7f73b-1914-4f84-869d-e541b805eec2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:56.868733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-74b7f73b-1914-4f84-869d-e541b805eec2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:56.876153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74b7f73b-1914-4f84-869d-e541b805eec2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:56.876612 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74b7f73b-1914-4f84-869d-e541b805eec2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:56.877396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74b7f73b-1914-4f84-869d-e541b805eec2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:56.877836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74b7f73b-1914-4f84-869d-e541b805eec2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:56.969203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:56.973039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:56.980424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:56.980965 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:56.981786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:56.982252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:57.065464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-74b7f73b-1914-4f84-869d-e541b805eec2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:57.078275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-74b7f73b-1914-4f84-869d-e541b805eec2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.217848 Jul 15 15:53:57.088836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 63/119] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:56 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:57.186522 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:57.195515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:57.197079 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:57.198204 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9de8fd78-d739-406f-bc58-259f02c20af4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.233675 Jul 15 15:53:57.198806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 57/120] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:56 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:53:57.303755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5e4b1b28-5330-4a64-8bb4-2027b06def24 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:57.305048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5e4b1b28-5330-4a64-8bb4-2027b06def24 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:57.311991 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e4b1b28-5330-4a64-8bb4-2027b06def24 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:57.312553 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e4b1b28-5330-4a64-8bb4-2027b06def24 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:57.313416 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e4b1b28-5330-4a64-8bb4-2027b06def24 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:57.313773 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e4b1b28-5330-4a64-8bb4-2027b06def24 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:57.468394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5e4b1b28-5330-4a64-8bb4-2027b06def24 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:57.475938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5e4b1b28-5330-4a64-8bb4-2027b06def24 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.176182 Jul 15 15:53:57.476515 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 64/121] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:57 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:57.761893 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4e67f87c-d54b-4d5f-9840-f0ef0ebf3949 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:57.762512 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4e67f87c-d54b-4d5f-9840-f0ef0ebf3949 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:57.771307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e67f87c-d54b-4d5f-9840-f0ef0ebf3949 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:57.774964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e67f87c-d54b-4d5f-9840-f0ef0ebf3949 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:57.775969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e67f87c-d54b-4d5f-9840-f0ef0ebf3949 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:57.779765 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e67f87c-d54b-4d5f-9840-f0ef0ebf3949 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:57.912961 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4e67f87c-d54b-4d5f-9840-f0ef0ebf3949 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:57.920417 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4e67f87c-d54b-4d5f-9840-f0ef0ebf3949 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.162369 Jul 15 15:53:57.921074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 58/122] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:57 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:58.095229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-65d8a44b-e111-437b-b7b9-d0610b720022 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:58.095872 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-65d8a44b-e111-437b-b7b9-d0610b720022 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:58.103390 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-65d8a44b-e111-437b-b7b9-d0610b720022 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:58.103852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-65d8a44b-e111-437b-b7b9-d0610b720022 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:58.104635 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-65d8a44b-e111-437b-b7b9-d0610b720022 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:58.105075 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-65d8a44b-e111-437b-b7b9-d0610b720022 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:58.217226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:58.217886 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:58.224075 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:58.224520 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:58.225336 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:58.225772 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:58.245359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-65d8a44b-e111-437b-b7b9-d0610b720022 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:58.253917 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-65d8a44b-e111-437b-b7b9-d0610b720022 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.162550 Jul 15 15:53:58.254559 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 65/123] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:58 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:58.353865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:58.362266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:58.363791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:58.364894 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-24d4e826-f56d-4b40-83e8-79deba55e158 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.152327 Jul 15 15:53:58.365495 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 59/124] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:58 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:53:58.497054 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-12ad7d73-b504-43ac-8e58-4124c93e89b8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:58.498305 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-12ad7d73-b504-43ac-8e58-4124c93e89b8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:58.504401 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-12ad7d73-b504-43ac-8e58-4124c93e89b8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:58.504854 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-12ad7d73-b504-43ac-8e58-4124c93e89b8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:58.505682 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-12ad7d73-b504-43ac-8e58-4124c93e89b8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:58.506120 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-12ad7d73-b504-43ac-8e58-4124c93e89b8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:58.632598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-12ad7d73-b504-43ac-8e58-4124c93e89b8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:58.639991 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-12ad7d73-b504-43ac-8e58-4124c93e89b8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.146926 Jul 15 15:53:58.640556 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 66/125] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:58 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:58.937220 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c8e0c2cc-2abd-4224-b84a-94545579f78c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:58.937822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c8e0c2cc-2abd-4224-b84a-94545579f78c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:58.943996 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c8e0c2cc-2abd-4224-b84a-94545579f78c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:58.944444 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c8e0c2cc-2abd-4224-b84a-94545579f78c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:58.945206 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c8e0c2cc-2abd-4224-b84a-94545579f78c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:58.945639 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c8e0c2cc-2abd-4224-b84a-94545579f78c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:59.076227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c8e0c2cc-2abd-4224-b84a-94545579f78c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:59.083589 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c8e0c2cc-2abd-4224-b84a-94545579f78c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.150167 Jul 15 15:53:59.084155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 60/126] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:58 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:59.270616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6e1a5309-f025-4ab9-b240-746860b0e0c9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:59.271231 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6e1a5309-f025-4ab9-b240-746860b0e0c9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:59.277275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6e1a5309-f025-4ab9-b240-746860b0e0c9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:59.277728 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6e1a5309-f025-4ab9-b240-746860b0e0c9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:59.278530 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6e1a5309-f025-4ab9-b240-746860b0e0c9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:59.279515 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6e1a5309-f025-4ab9-b240-746860b0e0c9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:59.383932 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:59.384549 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:59.392502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:59.393003 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:59.394008 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:59.394518 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:59.408418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6e1a5309-f025-4ab9-b240-746860b0e0c9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:59.415727 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:53:59.416154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6e1a5309-f025-4ab9-b240-746860b0e0c9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.149460 Jul 15 15:53:59.416745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 67/127] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:59 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:59.530400 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:59.538553 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:59.540097 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:59.541202 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2fc34201-b009-4cea-94cf-eaa4271c62e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.161148 Jul 15 15:53:59.541766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 61/128] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:53:59 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:53:59.656875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-74cc8e77-3851-4245-b1d1-8a9e188650b2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:59.657412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-74cc8e77-3851-4245-b1d1-8a9e188650b2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:59.663362 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74cc8e77-3851-4245-b1d1-8a9e188650b2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:59.663819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74cc8e77-3851-4245-b1d1-8a9e188650b2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:59.664588 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74cc8e77-3851-4245-b1d1-8a9e188650b2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:59.665029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74cc8e77-3851-4245-b1d1-8a9e188650b2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:59.798458 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-74cc8e77-3851-4245-b1d1-8a9e188650b2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:59.808756 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-74cc8e77-3851-4245-b1d1-8a9e188650b2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.155883 Jul 15 15:53:59.809327 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 68/129] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:59 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:00.101596 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7cf09bfa-a65e-47d8-a90c-794ccd6bcde3 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:00.102206 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7cf09bfa-a65e-47d8-a90c-794ccd6bcde3 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:00.110031 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7cf09bfa-a65e-47d8-a90c-794ccd6bcde3 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:00.110480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7cf09bfa-a65e-47d8-a90c-794ccd6bcde3 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:00.111253 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7cf09bfa-a65e-47d8-a90c-794ccd6bcde3 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:00.111717 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7cf09bfa-a65e-47d8-a90c-794ccd6bcde3 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:00.271215 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7cf09bfa-a65e-47d8-a90c-794ccd6bcde3 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:00.279362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7cf09bfa-a65e-47d8-a90c-794ccd6bcde3 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.181113 Jul 15 15:54:00.279927 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 62/130] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:00 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:00.433215 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6ec5b2ca-0cdd-41a1-8e9b-8ed230554065 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:00.433770 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6ec5b2ca-0cdd-41a1-8e9b-8ed230554065 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:00.440256 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6ec5b2ca-0cdd-41a1-8e9b-8ed230554065 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:00.441029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6ec5b2ca-0cdd-41a1-8e9b-8ed230554065 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:00.441707 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6ec5b2ca-0cdd-41a1-8e9b-8ed230554065 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:00.447340 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6ec5b2ca-0cdd-41a1-8e9b-8ed230554065 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:00.560160 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:00.562494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:00.568849 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:00.569296 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:00.570121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:00.570660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:00.583824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6ec5b2ca-0cdd-41a1-8e9b-8ed230554065 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:00.593103 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6ec5b2ca-0cdd-41a1-8e9b-8ed230554065 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.163737 Jul 15 15:54:00.593888 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 69/131] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:00 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:00.704623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:00.712709 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:00.714463 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:00.715588 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-08fd3138-8719-4e89-97b1-c7de8d541fbd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.160262 Jul 15 15:54:00.716827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 63/132] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:00 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:54:00.827079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-00e590d7-8e33-46ec-9f2a-c56e6f205d56 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:00.827739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-00e590d7-8e33-46ec-9f2a-c56e6f205d56 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:00.844881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00e590d7-8e33-46ec-9f2a-c56e6f205d56 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:00.844881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00e590d7-8e33-46ec-9f2a-c56e6f205d56 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:00.844881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00e590d7-8e33-46ec-9f2a-c56e6f205d56 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:00.844881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00e590d7-8e33-46ec-9f2a-c56e6f205d56 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:01.114840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-00e590d7-8e33-46ec-9f2a-c56e6f205d56 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:01.114840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-00e590d7-8e33-46ec-9f2a-c56e6f205d56 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.159010 Jul 15 15:54:01.114840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 70/133] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:00 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:01.296568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2b33a5ae-0fa2-4fe5-9e75-9e26ee4f8590 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:01.297190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2b33a5ae-0fa2-4fe5-9e75-9e26ee4f8590 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:01.303253 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b33a5ae-0fa2-4fe5-9e75-9e26ee4f8590 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:01.303739 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b33a5ae-0fa2-4fe5-9e75-9e26ee4f8590 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:01.304510 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b33a5ae-0fa2-4fe5-9e75-9e26ee4f8590 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:01.304950 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b33a5ae-0fa2-4fe5-9e75-9e26ee4f8590 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:01.621838 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7992bcbc-fbdc-4269-a240-ffa6b2da3787 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:01.623558 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7992bcbc-fbdc-4269-a240-ffa6b2da3787 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:01.631811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7992bcbc-fbdc-4269-a240-ffa6b2da3787 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:01.632687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7992bcbc-fbdc-4269-a240-ffa6b2da3787 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:01.633656 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7992bcbc-fbdc-4269-a240-ffa6b2da3787 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:01.634253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7992bcbc-fbdc-4269-a240-ffa6b2da3787 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:01.910393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2b33a5ae-0fa2-4fe5-9e75-9e26ee4f8590 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:01.919420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2b33a5ae-0fa2-4fe5-9e75-9e26ee4f8590 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.627076 Jul 15 15:54:01.920297 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 64/134] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:01 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:01.925696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:01.926580 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:01.939994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7992bcbc-fbdc-4269-a240-ffa6b2da3787 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:01.947997 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7992bcbc-fbdc-4269-a240-ffa6b2da3787 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.341541 Jul 15 15:54:01.950048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:01.969455 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 71/135] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:01 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:01.969563 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:01.969563 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:01.969563 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:02.026528 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1b70449b-66da-423e-a7a5-983a9903ec22 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ae59b80>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:02.081519 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1b70449b-66da-423e-a7a5-983a9903ec22 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/c3bb3dfb-7a6b-4b29-b2da-d78cf3eec6a1" status: 200 len: 351 microversion: 2.1 time: 0.058887 Jul 15 15:54:02.082065 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 72/136] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:54:02 2022] GET /compute/v2.1/os-volumes/c3bb3dfb-7a6b-4b29-b2da-d78cf3eec6a1 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:02.130986 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f7a6875d-d510-4291-ac4c-be4218900994 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:02.131811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f7a6875d-d510-4291-ac4c-be4218900994 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:02.142681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f7a6875d-d510-4291-ac4c-be4218900994 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:02.143696 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f7a6875d-d510-4291-ac4c-be4218900994 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:02.145669 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f7a6875d-d510-4291-ac4c-be4218900994 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:02.146619 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f7a6875d-d510-4291-ac4c-be4218900994 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:02.434060 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f7a6875d-d510-4291-ac4c-be4218900994 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:02.445410 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f7a6875d-d510-4291-ac4c-be4218900994 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.318704 Jul 15 15:54:02.446327 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 73/137] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:02 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:02.581601 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:02.592235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:02.599020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:02.599020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fbf3dbcb-139e-40d5-89f2-a8cacb1da369 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.673248 Jul 15 15:54:02.599020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 65/138] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:01 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:02.947805 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c8d99c13-8151-46bb-8ba6-cf79e8b5fdfc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:02.948428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c8d99c13-8151-46bb-8ba6-cf79e8b5fdfc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:02.961220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8d99c13-8151-46bb-8ba6-cf79e8b5fdfc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:02.961220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8d99c13-8151-46bb-8ba6-cf79e8b5fdfc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:02.961220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8d99c13-8151-46bb-8ba6-cf79e8b5fdfc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:02.961625 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8d99c13-8151-46bb-8ba6-cf79e8b5fdfc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:02.976189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6f89a90a-618c-4ce9-96c1-c87ded4d69bf tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:02.977390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6f89a90a-618c-4ce9-96c1-c87ded4d69bf tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:02.991447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f89a90a-618c-4ce9-96c1-c87ded4d69bf tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:02.993173 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f89a90a-618c-4ce9-96c1-c87ded4d69bf tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:02.995050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f89a90a-618c-4ce9-96c1-c87ded4d69bf tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:02.996967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f89a90a-618c-4ce9-96c1-c87ded4d69bf tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:03.188812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c8d99c13-8151-46bb-8ba6-cf79e8b5fdfc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:03.202545 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c8d99c13-8151-46bb-8ba6-cf79e8b5fdfc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.264940 Jul 15 15:54:03.202545 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 74/139] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:02 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:03.241672 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6f89a90a-618c-4ce9-96c1-c87ded4d69bf tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:03.256469 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6f89a90a-618c-4ce9-96c1-c87ded4d69bf tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.281272 Jul 15 15:54:03.260711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 66/140] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:02 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:03.273988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-0637a78f-e76f-465c-9371-f3ccdd63e7a2 req-87622aec-ea2b-4934-be10-4626713999ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d25c85d-d076-40e3-81e3-1a9c6a6a1968", "tag": "fa7b9eab-9027-4963-9a6c-667aa25aa523"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:03.284141 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-0637a78f-e76f-465c-9371-f3ccdd63e7a2 req-87622aec-ea2b-4934-be10-4626713999ef service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:03.285136 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-0637a78f-e76f-465c-9371-f3ccdd63e7a2 req-87622aec-ea2b-4934-be10-4626713999ef service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:03.299536 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-0637a78f-e76f-465c-9371-f3ccdd63e7a2 req-87622aec-ea2b-4934-be10-4626713999ef service nova] Creating event network-changed:fa7b9eab-9027-4963-9a6c-667aa25aa523 for instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 on hv-cinder-83587 Jul 15 15:54:03.305264 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-0637a78f-e76f-465c-9371-f3ccdd63e7a2 req-87622aec-ea2b-4934-be10-4626713999ef service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036307 Jul 15 15:54:03.306052 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 75/141] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:54:03.462367 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-042b541d-80d6-481d-84a4-000f154fa4d6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:03.463663 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-042b541d-80d6-481d-84a4-000f154fa4d6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:03.470781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-042b541d-80d6-481d-84a4-000f154fa4d6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:03.471476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-042b541d-80d6-481d-84a4-000f154fa4d6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:03.472443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-042b541d-80d6-481d-84a4-000f154fa4d6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:03.472922 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-042b541d-80d6-481d-84a4-000f154fa4d6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:03.613914 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:03.617102 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:03.636575 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:03.637028 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:03.637817 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:03.640475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:03.662577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-042b541d-80d6-481d-84a4-000f154fa4d6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:03.672197 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-042b541d-80d6-481d-84a4-000f154fa4d6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.213548 Jul 15 15:54:03.673201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 67/142] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:03 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:03.785396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:03.793522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:03.795128 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:03.796295 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-508e9bb6-a0fe-45de-91a1-22c82478d245 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.186593 Jul 15 15:54:03.797101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 76/143] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:03 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:54:04.221783 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6e87b2db-3ccb-4368-8416-cfe88f357556 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:04.222502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6e87b2db-3ccb-4368-8416-cfe88f357556 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:04.231034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e87b2db-3ccb-4368-8416-cfe88f357556 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:04.231034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e87b2db-3ccb-4368-8416-cfe88f357556 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:04.231034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e87b2db-3ccb-4368-8416-cfe88f357556 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:04.231034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e87b2db-3ccb-4368-8416-cfe88f357556 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:04.274184 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-21c27ae7-4e1f-45cf-a1e7-972c6ab2a8b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:04.274806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-21c27ae7-4e1f-45cf-a1e7-972c6ab2a8b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:04.281234 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21c27ae7-4e1f-45cf-a1e7-972c6ab2a8b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:04.281695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21c27ae7-4e1f-45cf-a1e7-972c6ab2a8b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:04.282719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21c27ae7-4e1f-45cf-a1e7-972c6ab2a8b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:04.283161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21c27ae7-4e1f-45cf-a1e7-972c6ab2a8b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:04.382168 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6e87b2db-3ccb-4368-8416-cfe88f357556 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:04.395464 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6e87b2db-3ccb-4368-8416-cfe88f357556 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.176893 Jul 15 15:54:04.396621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 68/144] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:04 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:04.451374 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-21c27ae7-4e1f-45cf-a1e7-972c6ab2a8b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:04.458843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-21c27ae7-4e1f-45cf-a1e7-972c6ab2a8b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.188332 Jul 15 15:54:04.459476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 77/145] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:04 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:04.688500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-238990a1-4056-4152-9990-2485003c55af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:04.689111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-238990a1-4056-4152-9990-2485003c55af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:04.695035 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-238990a1-4056-4152-9990-2485003c55af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:04.695594 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-238990a1-4056-4152-9990-2485003c55af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:04.696353 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-238990a1-4056-4152-9990-2485003c55af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:04.696786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-238990a1-4056-4152-9990-2485003c55af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:04.818864 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:04.819987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:04.827509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-238990a1-4056-4152-9990-2485003c55af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:04.829077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:04.829726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:04.831091 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:04.831739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:04.835153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-238990a1-4056-4152-9990-2485003c55af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.150448 Jul 15 15:54:04.835781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 69/146] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:04 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:04.970472 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:04.978904 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:04.980478 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:04.981604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-497b5af5-011b-40bd-80af-ecf736153008 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.168280 Jul 15 15:54:04.982885 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 78/147] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:04 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:54:05.202938 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e61853a1-e129-4913-8bf6-9a3510e7d48b tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ae0e9d0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.247141 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e61853a1-e129-4913-8bf6-9a3510e7d48b tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/cbc2af55-bbd4-4b16-9243-c954b0d9bf18" status: 200 len: 350 microversion: 2.1 time: 0.052136 Jul 15 15:54:05.248635 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 70/148] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/os-volumes/cbc2af55-bbd4-4b16-9243-c954b0d9bf18 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:05.259467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cce46ec9-1d91-486e-9571-90d827df0377 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ae07c10>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.346648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cce46ec9-1d91-486e-9571-90d827df0377 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089553 Jul 15 15:54:05.347236 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 79/149] 10.222.0.98 () {58 vars in 1133 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:05.359823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-06c2a775-42e5-4e31-ae09-2a7fbbead1cc tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ae1fca0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.413008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d5cf06fa-b5b7-4148-9c0d-1910eb2ef496 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.414044 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d5cf06fa-b5b7-4148-9c0d-1910eb2ef496 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:05.421438 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5cf06fa-b5b7-4148-9c0d-1910eb2ef496 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:05.421882 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5cf06fa-b5b7-4148-9c0d-1910eb2ef496 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:05.422652 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5cf06fa-b5b7-4148-9c0d-1910eb2ef496 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:05.423122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5cf06fa-b5b7-4148-9c0d-1910eb2ef496 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:05.502174 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-06c2a775-42e5-4e31-ae09-2a7fbbead1cc tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.146609 Jul 15 15:54:05.502761 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 71/150] 10.222.0.98 () {58 vars in 1148 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:05.508245 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c80ca735-a45c-473c-a7dd-96d775d67709 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.509095 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c80ca735-a45c-473c-a7dd-96d775d67709 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:05.516486 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c80ca735-a45c-473c-a7dd-96d775d67709 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:05.516939 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c80ca735-a45c-473c-a7dd-96d775d67709 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:05.517749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c80ca735-a45c-473c-a7dd-96d775d67709 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:05.518453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c80ca735-a45c-473c-a7dd-96d775d67709 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:05.570273 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d5cf06fa-b5b7-4148-9c0d-1910eb2ef496 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:05.578490 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d5cf06fa-b5b7-4148-9c0d-1910eb2ef496 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.169338 Jul 15 15:54:05.579053 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 80/151] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:05.583516 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0c9b2f3a-6db4-4759-a9d6-e8bbed7a904b tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ae07430>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.659323 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c80ca735-a45c-473c-a7dd-96d775d67709 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:05.666906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c80ca735-a45c-473c-a7dd-96d775d67709 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.162947 Jul 15 15:54:05.667483 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 72/152] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:05.683154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0c9b2f3a-6db4-4759-a9d6-e8bbed7a904b tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.102999 Jul 15 15:54:05.683759 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 81/153] 10.222.0.98 () {58 vars in 1133 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:05.697967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-da5ae07c-b64f-4617-99db-85315a74b2e4 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ae0e700>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.781597 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-da5ae07c-b64f-4617-99db-85315a74b2e4 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087402 Jul 15 15:54:05.782187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 73/154] 10.222.0.98 () {58 vars in 1166 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:05.793663 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-582916a3-aff1-45fe-9884-e94041dfa230 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ad21160>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.852718 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0938bea1-9ac4-404e-bfc1-0e439cb59574 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.853349 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0938bea1-9ac4-404e-bfc1-0e439cb59574 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:05.859651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0938bea1-9ac4-404e-bfc1-0e439cb59574 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:05.861656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0938bea1-9ac4-404e-bfc1-0e439cb59574 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:05.861656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0938bea1-9ac4-404e-bfc1-0e439cb59574 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:05.861656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0938bea1-9ac4-404e-bfc1-0e439cb59574 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:05.876757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-582916a3-aff1-45fe-9884-e94041dfa230 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086831 Jul 15 15:54:05.877329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 82/155] 10.222.0.98 () {58 vars in 1169 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:05.889438 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8c66773b-8fed-4734-8608-55b8969b1a23 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510adc5670>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.970232 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8c66773b-8fed-4734-8608-55b8969b1a23 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084822 Jul 15 15:54:05.971025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 83/156] 10.222.0.98 () {58 vars in 1154 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:05.981913 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-57947612-368b-43c2-8640-e20d50959ca5 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ad21dc0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:05.997037 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0938bea1-9ac4-404e-bfc1-0e439cb59574 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:06.004994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0938bea1-9ac4-404e-bfc1-0e439cb59574 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.156301 Jul 15 15:54:06.005565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 74/157] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:06.009961 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:06.014049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:06.017164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:06.017618 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:06.018379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:06.018817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:06.061696 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-57947612-368b-43c2-8640-e20d50959ca5 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083228 Jul 15 15:54:06.062597 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 84/158] 10.222.0.98 () {58 vars in 1187 bytes} [Fri Jul 15 15:54:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:54:06.074727 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1b0bc9e0-44f2-4d38-8ff5-c2b774fb9ea7 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] Calling method '.version_select at 0x7f510ae59b80>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:06.148802 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:06.158898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1b0bc9e0-44f2-4d38-8ff5-c2b774fb9ea7 tempest-VolumesTestJSON-962132240 tempest-VolumesTestJSON-962132240-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087759 Jul 15 15:54:06.159503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 85/159] 10.222.0.98 () {58 vars in 1154 bytes} [Fri Jul 15 15:54:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:06.159628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:06.162776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:06.162776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fe4f7aa8-190c-4566-a896-c65c2426b306 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.155765 Jul 15 15:54:06.163012 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 75/160] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:06 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:06.595398 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-55924496-5f96-45f6-aeb2-8b759b1fc3c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:06.596019 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-55924496-5f96-45f6-aeb2-8b759b1fc3c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:06.602560 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-55924496-5f96-45f6-aeb2-8b759b1fc3c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:06.603013 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-55924496-5f96-45f6-aeb2-8b759b1fc3c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:06.603815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-55924496-5f96-45f6-aeb2-8b759b1fc3c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:06.604257 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-55924496-5f96-45f6-aeb2-8b759b1fc3c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:06.684033 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7ce23c8e-cdd3-4d35-9772-a8223b52aa92 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:06.714781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7ce23c8e-cdd3-4d35-9772-a8223b52aa92 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:06.714781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7ce23c8e-cdd3-4d35-9772-a8223b52aa92 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:06.714781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7ce23c8e-cdd3-4d35-9772-a8223b52aa92 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:06.714781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7ce23c8e-cdd3-4d35-9772-a8223b52aa92 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:06.715134 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7ce23c8e-cdd3-4d35-9772-a8223b52aa92 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:06.735547 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-55924496-5f96-45f6-aeb2-8b759b1fc3c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:06.743131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-55924496-5f96-45f6-aeb2-8b759b1fc3c0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.151709 Jul 15 15:54:06.743741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 86/161] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:06 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:06.831602 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7ce23c8e-cdd3-4d35-9772-a8223b52aa92 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:06.839259 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7ce23c8e-cdd3-4d35-9772-a8223b52aa92 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.159005 Jul 15 15:54:06.839841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 76/162] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:06 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:07.022752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fb2dba7b-a615-4dfe-9e0b-0473fc3c8c6e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:07.023328 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fb2dba7b-a615-4dfe-9e0b-0473fc3c8c6e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:07.030570 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fb2dba7b-a615-4dfe-9e0b-0473fc3c8c6e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:07.031026 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fb2dba7b-a615-4dfe-9e0b-0473fc3c8c6e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:07.031892 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fb2dba7b-a615-4dfe-9e0b-0473fc3c8c6e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:07.032330 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fb2dba7b-a615-4dfe-9e0b-0473fc3c8c6e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:07.036403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:07.177310 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fb2dba7b-a615-4dfe-9e0b-0473fc3c8c6e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:07.180665 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:07.181361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:07.185447 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fb2dba7b-a615-4dfe-9e0b-0473fc3c8c6e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.166093 Jul 15 15:54:07.186095 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 87/163] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:07 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:07.188362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:07.188890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:07.189733 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:07.190331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:07.510093 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:07.519220 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:07.521393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:07.522557 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a0636fe2-6bb4-4267-a256-2bcbf598119a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.345808 Jul 15 15:54:07.523122 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 77/164] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:07 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:07.760536 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-101fb4ce-2266-435e-ac70-7a5a02d8c04f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:07.761151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-101fb4ce-2266-435e-ac70-7a5a02d8c04f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:07.767314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-101fb4ce-2266-435e-ac70-7a5a02d8c04f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:07.767778 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-101fb4ce-2266-435e-ac70-7a5a02d8c04f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:07.768552 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-101fb4ce-2266-435e-ac70-7a5a02d8c04f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:07.768987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-101fb4ce-2266-435e-ac70-7a5a02d8c04f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:07.855795 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d8060f84-5d11-489c-a758-26abbcfa683e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:07.862013 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d8060f84-5d11-489c-a758-26abbcfa683e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:07.863861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d8060f84-5d11-489c-a758-26abbcfa683e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:07.864312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d8060f84-5d11-489c-a758-26abbcfa683e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:07.865132 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d8060f84-5d11-489c-a758-26abbcfa683e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:07.865575 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d8060f84-5d11-489c-a758-26abbcfa683e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:07.900294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-101fb4ce-2266-435e-ac70-7a5a02d8c04f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:07.908466 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-101fb4ce-2266-435e-ac70-7a5a02d8c04f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.151692 Jul 15 15:54:07.909050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 88/165] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:07 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:07.995044 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d8060f84-5d11-489c-a758-26abbcfa683e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:08.002650 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d8060f84-5d11-489c-a758-26abbcfa683e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.150715 Jul 15 15:54:08.003209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 78/166] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:07 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:08.202850 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3e50050f-1d70-4a3e-9dff-deab6df2106c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:08.203483 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3e50050f-1d70-4a3e-9dff-deab6df2106c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:08.209557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e50050f-1d70-4a3e-9dff-deab6df2106c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:08.210006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e50050f-1d70-4a3e-9dff-deab6df2106c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:08.210771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e50050f-1d70-4a3e-9dff-deab6df2106c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:08.211199 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e50050f-1d70-4a3e-9dff-deab6df2106c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:08.334977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3e50050f-1d70-4a3e-9dff-deab6df2106c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:08.343380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3e50050f-1d70-4a3e-9dff-deab6df2106c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.144862 Jul 15 15:54:08.343956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 89/167] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:08 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:08.540831 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:08.541452 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:08.547797 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:08.548249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:08.549024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:08.549462 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:08.679878 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:08.688373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:08.689866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:08.690965 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8c56b771-750f-43c5-a66f-fcdb70547695 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.154083 Jul 15 15:54:08.691571 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 79/168] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:08 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:08.925785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ba8f6ae3-90fa-4b73-b8cf-144e7bf24fb4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:08.926442 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ba8f6ae3-90fa-4b73-b8cf-144e7bf24fb4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:08.932493 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba8f6ae3-90fa-4b73-b8cf-144e7bf24fb4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:08.932948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba8f6ae3-90fa-4b73-b8cf-144e7bf24fb4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:08.933739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba8f6ae3-90fa-4b73-b8cf-144e7bf24fb4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:08.934207 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba8f6ae3-90fa-4b73-b8cf-144e7bf24fb4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.020610 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-85de5442-3a84-48b7-a3bb-37ad4a38bf40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:09.021865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-85de5442-3a84-48b7-a3bb-37ad4a38bf40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:09.030195 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-85de5442-3a84-48b7-a3bb-37ad4a38bf40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.030976 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-85de5442-3a84-48b7-a3bb-37ad4a38bf40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.032200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-85de5442-3a84-48b7-a3bb-37ad4a38bf40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.033062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-85de5442-3a84-48b7-a3bb-37ad4a38bf40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.184512 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-85de5442-3a84-48b7-a3bb-37ad4a38bf40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:09.193666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-85de5442-3a84-48b7-a3bb-37ad4a38bf40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.177722 Jul 15 15:54:09.194774 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 80/169] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:09 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:09.231287 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ba8f6ae3-90fa-4b73-b8cf-144e7bf24fb4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:09.237401 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ba8f6ae3-90fa-4b73-b8cf-144e7bf24fb4 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.315400 Jul 15 15:54:09.238094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 90/170] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:08 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:09.283164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-6ed23d0c-a87c-4917-b78a-45b7c9d0a40e req-b0dbece3-3309-410d-896f-e061f597eefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5", "name": "network-vif-plugged", "status": "completed", "tag": "e7800a16-36db-4bcb-be6d-391c82f24f64"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:09.293878 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-6ed23d0c-a87c-4917-b78a-45b7c9d0a40e req-b0dbece3-3309-410d-896f-e061f597eefd service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.294312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-6ed23d0c-a87c-4917-b78a-45b7c9d0a40e req-b0dbece3-3309-410d-896f-e061f597eefd service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.306169 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:09.313232 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-6ed23d0c-a87c-4917-b78a-45b7c9d0a40e req-b0dbece3-3309-410d-896f-e061f597eefd service nova] Creating event network-vif-plugged:e7800a16-36db-4bcb-be6d-391c82f24f64 for instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 on hv-cinder-83587 Jul 15 15:54:09.313750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-6ed23d0c-a87c-4917-b78a-45b7c9d0a40e req-b0dbece3-3309-410d-896f-e061f597eefd service nova] Acquired lock "compute-rpcapi-router" {{(pid=130091) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 15:54:09.319778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-90283c01-8a6c-419f-94e6-d1fe5f04b487 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.319778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-90283c01-8a6c-419f-94e6-d1fe5f04b487 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.319778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-90283c01-8a6c-419f-94e6-d1fe5f04b487 None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.319778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-90283c01-8a6c-419f-94e6-d1fe5f04b487 None None] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.324758 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.compute.rpcapi [None req-90283c01-8a6c-419f-94e6-d1fe5f04b487 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 15:54:09.325603 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-90283c01-8a6c-419f-94e6-d1fe5f04b487 None None] Releasing lock "compute-rpcapi-router" {{(pid=130091) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 15:54:09.340698 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-90283c01-8a6c-419f-94e6-d1fe5f04b487 None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118128 Jul 15 15:54:09.341217 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 81/171] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:54:09.359695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4b21dcaa-495a-4b25-9985-9e35bc72f4c1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:09.360312 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4b21dcaa-495a-4b25-9985-9e35bc72f4c1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:09.366359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b21dcaa-495a-4b25-9985-9e35bc72f4c1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.366812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b21dcaa-495a-4b25-9985-9e35bc72f4c1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.367613 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b21dcaa-495a-4b25-9985-9e35bc72f4c1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.368053 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b21dcaa-495a-4b25-9985-9e35bc72f4c1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.508907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4b21dcaa-495a-4b25-9985-9e35bc72f4c1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:09.516969 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4b21dcaa-495a-4b25-9985-9e35bc72f4c1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.161703 Jul 15 15:54:09.517650 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 91/172] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:09 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:09.712082 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:09.723907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:09.723907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.723907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.723907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:09.724477 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:09.856337 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:09.864529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:09.866033 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:09.867130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-71e3abad-9bb6-4c3e-a200-3268ca2191d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.160151 Jul 15 15:54:09.867714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 82/173] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:09 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:10.210632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e5805152-eb68-4d68-b25d-7e0284c7a1b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:10.211323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e5805152-eb68-4d68-b25d-7e0284c7a1b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:10.217606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5805152-eb68-4d68-b25d-7e0284c7a1b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:10.218089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5805152-eb68-4d68-b25d-7e0284c7a1b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:10.218861 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5805152-eb68-4d68-b25d-7e0284c7a1b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:10.219445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5805152-eb68-4d68-b25d-7e0284c7a1b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:10.254576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e0f41764-9f2d-43f3-b0ad-5fd9e593c75d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:10.266637 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e0f41764-9f2d-43f3-b0ad-5fd9e593c75d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:10.266637 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e0f41764-9f2d-43f3-b0ad-5fd9e593c75d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:10.266637 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e0f41764-9f2d-43f3-b0ad-5fd9e593c75d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:10.266637 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e0f41764-9f2d-43f3-b0ad-5fd9e593c75d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:10.267050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e0f41764-9f2d-43f3-b0ad-5fd9e593c75d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:10.353750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e5805152-eb68-4d68-b25d-7e0284c7a1b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:10.361903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e5805152-eb68-4d68-b25d-7e0284c7a1b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.155355 Jul 15 15:54:10.362487 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 92/174] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:10 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:10.404711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e0f41764-9f2d-43f3-b0ad-5fd9e593c75d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:10.408518 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e0f41764-9f2d-43f3-b0ad-5fd9e593c75d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.157581 Jul 15 15:54:10.409094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 83/175] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:10 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:10.535070 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ffb1e2cc-1f99-4ab9-98a3-368a1a82a569 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:10.535626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ffb1e2cc-1f99-4ab9-98a3-368a1a82a569 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:10.541722 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ffb1e2cc-1f99-4ab9-98a3-368a1a82a569 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:10.542173 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ffb1e2cc-1f99-4ab9-98a3-368a1a82a569 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:10.542937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ffb1e2cc-1f99-4ab9-98a3-368a1a82a569 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:10.543413 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ffb1e2cc-1f99-4ab9-98a3-368a1a82a569 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:10.675567 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ffb1e2cc-1f99-4ab9-98a3-368a1a82a569 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:10.682986 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ffb1e2cc-1f99-4ab9-98a3-368a1a82a569 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.151776 Jul 15 15:54:10.683718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 93/176] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:10 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:10.885078 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:10.885694 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:10.892851 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:10.893206 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:10.894003 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:10.894529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:11.037109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:11.045865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:11.047455 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:11.049024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8049c637-d1bb-4604-9fbd-54f36453244a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.167567 Jul 15 15:54:11.049489 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 84/177] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:10 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:11.378132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3d060048-2fb5-4ab4-b8b2-dba178884bba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:11.378829 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3d060048-2fb5-4ab4-b8b2-dba178884bba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:11.385028 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d060048-2fb5-4ab4-b8b2-dba178884bba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:11.387396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d060048-2fb5-4ab4-b8b2-dba178884bba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:11.387396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d060048-2fb5-4ab4-b8b2-dba178884bba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:11.387396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d060048-2fb5-4ab4-b8b2-dba178884bba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:11.425473 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-aa734ca7-83f7-411d-bf43-b8e138909919 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:11.426218 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-aa734ca7-83f7-411d-bf43-b8e138909919 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:11.433001 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa734ca7-83f7-411d-bf43-b8e138909919 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:11.433733 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa734ca7-83f7-411d-bf43-b8e138909919 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:11.435048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa734ca7-83f7-411d-bf43-b8e138909919 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:11.436129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa734ca7-83f7-411d-bf43-b8e138909919 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:11.542961 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3d060048-2fb5-4ab4-b8b2-dba178884bba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:11.548653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3d060048-2fb5-4ab4-b8b2-dba178884bba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.174380 Jul 15 15:54:11.549450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 94/178] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:11 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:11.597970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-aa734ca7-83f7-411d-bf43-b8e138909919 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:11.605412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-aa734ca7-83f7-411d-bf43-b8e138909919 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.184011 Jul 15 15:54:11.606107 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 85/179] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:11 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:11.699589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-836ecc42-ae99-4309-b52a-3aee7c482cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:11.700204 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-836ecc42-ae99-4309-b52a-3aee7c482cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:11.711500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-836ecc42-ae99-4309-b52a-3aee7c482cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:11.714958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-836ecc42-ae99-4309-b52a-3aee7c482cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:11.714958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-836ecc42-ae99-4309-b52a-3aee7c482cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:11.714958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-836ecc42-ae99-4309-b52a-3aee7c482cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:11.858179 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-836ecc42-ae99-4309-b52a-3aee7c482cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:11.862760 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-836ecc42-ae99-4309-b52a-3aee7c482cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.167074 Jul 15 15:54:11.863365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 95/180] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:11 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:12.067220 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:12.067879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:12.074144 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:12.075357 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:12.075468 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:12.076426 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:12.259074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:12.267763 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:12.269248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:12.270334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-246e8cac-19f6-494e-91e0-eb53963fa9bb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.208114 Jul 15 15:54:12.270896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 86/181] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:12 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:12.566660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-248461da-bf3c-405b-9563-85d1ec19bb89 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:12.567328 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-248461da-bf3c-405b-9563-85d1ec19bb89 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:12.574042 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-248461da-bf3c-405b-9563-85d1ec19bb89 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:12.574605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-248461da-bf3c-405b-9563-85d1ec19bb89 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:12.575418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-248461da-bf3c-405b-9563-85d1ec19bb89 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:12.575884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-248461da-bf3c-405b-9563-85d1ec19bb89 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:12.621835 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-67229ab5-ffe4-41cd-97ae-9bf282ccce58 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:12.622448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-67229ab5-ffe4-41cd-97ae-9bf282ccce58 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:12.629333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-67229ab5-ffe4-41cd-97ae-9bf282ccce58 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:12.629636 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-67229ab5-ffe4-41cd-97ae-9bf282ccce58 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:12.630407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-67229ab5-ffe4-41cd-97ae-9bf282ccce58 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:12.630839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-67229ab5-ffe4-41cd-97ae-9bf282ccce58 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:12.733331 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-248461da-bf3c-405b-9563-85d1ec19bb89 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:12.740649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-248461da-bf3c-405b-9563-85d1ec19bb89 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.178089 Jul 15 15:54:12.741225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 96/182] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:12 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:12.774222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-67229ab5-ffe4-41cd-97ae-9bf282ccce58 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:12.782360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-67229ab5-ffe4-41cd-97ae-9bf282ccce58 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.164343 Jul 15 15:54:12.782921 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 87/183] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:12 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:12.879996 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-377ba515-9887-4ac5-a841-e1e9eff56fff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:12.880607 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-377ba515-9887-4ac5-a841-e1e9eff56fff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:12.886633 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-377ba515-9887-4ac5-a841-e1e9eff56fff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:12.887068 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-377ba515-9887-4ac5-a841-e1e9eff56fff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:12.887854 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-377ba515-9887-4ac5-a841-e1e9eff56fff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:12.888310 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-377ba515-9887-4ac5-a841-e1e9eff56fff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:13.023107 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-377ba515-9887-4ac5-a841-e1e9eff56fff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:13.030949 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-377ba515-9887-4ac5-a841-e1e9eff56fff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.154784 Jul 15 15:54:13.031556 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 97/184] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:12 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:13.288190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:13.288903 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:13.295445 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:13.295903 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:13.296679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:13.297187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:13.463261 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:13.476264 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:13.477869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:13.479514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-965bf5d9-1f28-47f3-8a6e-586a5ef22cf0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.194995 Jul 15 15:54:13.483324 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 88/185] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:13 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:13.757231 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9ed9280e-1f48-45df-9b42-2d4fc945b4d3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:13.757771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9ed9280e-1f48-45df-9b42-2d4fc945b4d3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:13.760671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:13.764685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9ed9280e-1f48-45df-9b42-2d4fc945b4d3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:13.765133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9ed9280e-1f48-45df-9b42-2d4fc945b4d3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:13.765897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9ed9280e-1f48-45df-9b42-2d4fc945b4d3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:13.766332 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9ed9280e-1f48-45df-9b42-2d4fc945b4d3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:13.817861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f3cf277c-edbc-4a0c-a455-cb20ba68a7c7 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:13.817861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f3cf277c-edbc-4a0c-a455-cb20ba68a7c7 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:13.830973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f3cf277c-edbc-4a0c-a455-cb20ba68a7c7 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:13.833974 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f3cf277c-edbc-4a0c-a455-cb20ba68a7c7 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:13.834850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f3cf277c-edbc-4a0c-a455-cb20ba68a7c7 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:13.835264 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f3cf277c-edbc-4a0c-a455-cb20ba68a7c7 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:13.928665 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9ed9280e-1f48-45df-9b42-2d4fc945b4d3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:13.937912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9ed9280e-1f48-45df-9b42-2d4fc945b4d3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.184468 Jul 15 15:54:13.938503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 98/186] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:13 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:13.988816 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f3cf277c-edbc-4a0c-a455-cb20ba68a7c7 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:13.996236 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f3cf277c-edbc-4a0c-a455-cb20ba68a7c7 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.201074 Jul 15 15:54:14.002748 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 89/187] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:13 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:14.048738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b685dc66-d459-4e8c-a3f6-ccef1a3f21ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:14.048738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b685dc66-d459-4e8c-a3f6-ccef1a3f21ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:14.054151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b685dc66-d459-4e8c-a3f6-ccef1a3f21ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:14.054674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b685dc66-d459-4e8c-a3f6-ccef1a3f21ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:14.055485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b685dc66-d459-4e8c-a3f6-ccef1a3f21ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:14.055942 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b685dc66-d459-4e8c-a3f6-ccef1a3f21ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:14.183990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b685dc66-d459-4e8c-a3f6-ccef1a3f21ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:14.191733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b685dc66-d459-4e8c-a3f6-ccef1a3f21ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.148572 Jul 15 15:54:14.192303 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 99/188] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:14 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:14.503543 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:14.504164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:14.510390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:14.510999 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:14.511851 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:14.512246 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:14.643684 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:14.651642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:14.653135 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:14.654265 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-891cfe73-8623-4729-9085-c8217d26f52d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.155099 Jul 15 15:54:14.654823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 90/189] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:14 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:14.954921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-90dbcffc-f1de-4ebd-9ec4-011f60aaa2fe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:14.955563 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-90dbcffc-f1de-4ebd-9ec4-011f60aaa2fe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:14.961510 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-90dbcffc-f1de-4ebd-9ec4-011f60aaa2fe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:14.961965 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-90dbcffc-f1de-4ebd-9ec4-011f60aaa2fe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:14.962882 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-90dbcffc-f1de-4ebd-9ec4-011f60aaa2fe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:14.963348 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-90dbcffc-f1de-4ebd-9ec4-011f60aaa2fe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:15.012458 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dfb32354-df19-49ee-8b47-dc6349d61f2e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:15.013195 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dfb32354-df19-49ee-8b47-dc6349d61f2e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:15.020116 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dfb32354-df19-49ee-8b47-dc6349d61f2e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:15.020570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dfb32354-df19-49ee-8b47-dc6349d61f2e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:15.021345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dfb32354-df19-49ee-8b47-dc6349d61f2e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:15.021916 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dfb32354-df19-49ee-8b47-dc6349d61f2e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:15.100191 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-90dbcffc-f1de-4ebd-9ec4-011f60aaa2fe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:15.109290 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-90dbcffc-f1de-4ebd-9ec4-011f60aaa2fe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.158674 Jul 15 15:54:15.110255 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 100/190] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:14 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:15.158761 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-dfb32354-df19-49ee-8b47-dc6349d61f2e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:15.166646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dfb32354-df19-49ee-8b47-dc6349d61f2e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.158244 Jul 15 15:54:15.167327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 91/191] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:15 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:15.207909 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-473b3b4c-101b-4ef3-88a3-973125ed8c7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:15.208555 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-473b3b4c-101b-4ef3-88a3-973125ed8c7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:15.215389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-473b3b4c-101b-4ef3-88a3-973125ed8c7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:15.215854 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-473b3b4c-101b-4ef3-88a3-973125ed8c7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:15.217154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-473b3b4c-101b-4ef3-88a3-973125ed8c7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:15.217598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-473b3b4c-101b-4ef3-88a3-973125ed8c7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:15.352668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-473b3b4c-101b-4ef3-88a3-973125ed8c7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:15.360292 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-473b3b4c-101b-4ef3-88a3-973125ed8c7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.156250 Jul 15 15:54:15.364028 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 101/192] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:15 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:15.671959 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:15.672576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:15.678861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:15.679337 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:15.680115 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:15.680550 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:15.809258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:15.817312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:15.818913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:15.820080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0447c056-67ee-4017-a0d1-d5cc11a76869 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.152482 Jul 15 15:54:15.820642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 92/193] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:15 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:16.126252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-713eaa1d-4fa3-4a68-abd2-3152e38ac532 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:16.127175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-713eaa1d-4fa3-4a68-abd2-3152e38ac532 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:16.133178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-713eaa1d-4fa3-4a68-abd2-3152e38ac532 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:16.133626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-713eaa1d-4fa3-4a68-abd2-3152e38ac532 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:16.134392 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-713eaa1d-4fa3-4a68-abd2-3152e38ac532 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:16.134871 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-713eaa1d-4fa3-4a68-abd2-3152e38ac532 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:16.183970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3ed8b29c-e8f0-4816-950f-395113bf744b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:16.185129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3ed8b29c-e8f0-4816-950f-395113bf744b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:16.192555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3ed8b29c-e8f0-4816-950f-395113bf744b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:16.193003 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3ed8b29c-e8f0-4816-950f-395113bf744b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:16.193969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3ed8b29c-e8f0-4816-950f-395113bf744b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:16.194415 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3ed8b29c-e8f0-4816-950f-395113bf744b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:16.281668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-713eaa1d-4fa3-4a68-abd2-3152e38ac532 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:16.289540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-713eaa1d-4fa3-4a68-abd2-3152e38ac532 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.167507 Jul 15 15:54:16.290356 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 102/194] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:16 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:16.353971 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3ed8b29c-e8f0-4816-950f-395113bf744b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:16.362076 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3ed8b29c-e8f0-4816-950f-395113bf744b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.181793 Jul 15 15:54:16.362647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 93/195] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:16 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:16.377138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8faa0a78-d18b-43c4-9139-231f46092b1f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:16.377675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8faa0a78-d18b-43c4-9139-231f46092b1f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:16.383713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8faa0a78-d18b-43c4-9139-231f46092b1f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:16.384154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8faa0a78-d18b-43c4-9139-231f46092b1f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:16.385138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8faa0a78-d18b-43c4-9139-231f46092b1f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:16.385579 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8faa0a78-d18b-43c4-9139-231f46092b1f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:16.523912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8faa0a78-d18b-43c4-9139-231f46092b1f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:16.527363 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:16.531706 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8faa0a78-d18b-43c4-9139-231f46092b1f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.159050 Jul 15 15:54:16.532270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 103/196] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:16 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:16.838219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:16.839070 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:16.845418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:16.846022 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:16.846834 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:16.847281 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:17.002326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:17.011231 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:17.012827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:17.014503 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e61b9770-bed8-47c7-a2f4-4ca2d188138e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.180197 Jul 15 15:54:17.015235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 94/197] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:16 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:17.306674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b7b8f6aa-6cac-4ca5-acfa-32f8167500e3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:17.307316 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b7b8f6aa-6cac-4ca5-acfa-32f8167500e3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:17.314360 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b7b8f6aa-6cac-4ca5-acfa-32f8167500e3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:17.314815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b7b8f6aa-6cac-4ca5-acfa-32f8167500e3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:17.315616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b7b8f6aa-6cac-4ca5-acfa-32f8167500e3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:17.316055 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b7b8f6aa-6cac-4ca5-acfa-32f8167500e3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:17.378956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-29ffddfb-94d6-409c-9ab5-713deb2194a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:17.380348 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-29ffddfb-94d6-409c-9ab5-713deb2194a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:17.389375 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-29ffddfb-94d6-409c-9ab5-713deb2194a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:17.389375 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-29ffddfb-94d6-409c-9ab5-713deb2194a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:17.390270 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-29ffddfb-94d6-409c-9ab5-713deb2194a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:17.390816 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-29ffddfb-94d6-409c-9ab5-713deb2194a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:17.470557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b7b8f6aa-6cac-4ca5-acfa-32f8167500e3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:17.478294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b7b8f6aa-6cac-4ca5-acfa-32f8167500e3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.175598 Jul 15 15:54:17.478948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 104/198] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:17 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:17.492690 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-da32d7aa-0768-48fd-a811-a3bc026701cb req-1511b97b-6831-4f5c-8b38-db3e15f9307c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340a548f-e53b-443d-a606-fefe96076882", "name": "network-vif-plugged", "status": "completed", "tag": "cc489b1f-e51c-4189-a789-13fa2d662f4f"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:17.501277 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-da32d7aa-0768-48fd-a811-a3bc026701cb req-1511b97b-6831-4f5c-8b38-db3e15f9307c service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:17.501673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-da32d7aa-0768-48fd-a811-a3bc026701cb req-1511b97b-6831-4f5c-8b38-db3e15f9307c service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:17.516007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-da32d7aa-0768-48fd-a811-a3bc026701cb req-1511b97b-6831-4f5c-8b38-db3e15f9307c service nova] Creating event network-vif-plugged:cc489b1f-e51c-4189-a789-13fa2d662f4f for instance 340a548f-e53b-443d-a606-fefe96076882 on hv-cinder-83587 Jul 15 15:54:17.522336 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-da32d7aa-0768-48fd-a811-a3bc026701cb req-1511b97b-6831-4f5c-8b38-db3e15f9307c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033091 Jul 15 15:54:17.523275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 105/199] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:17.549702 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-29ffddfb-94d6-409c-9ab5-713deb2194a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:17.550410 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8cae9829-b21b-4ffd-a044-0154b52cbabf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:17.551321 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8cae9829-b21b-4ffd-a044-0154b52cbabf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:17.558995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8cae9829-b21b-4ffd-a044-0154b52cbabf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:17.559616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8cae9829-b21b-4ffd-a044-0154b52cbabf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:17.560440 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8cae9829-b21b-4ffd-a044-0154b52cbabf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:17.560938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8cae9829-b21b-4ffd-a044-0154b52cbabf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:17.561316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-29ffddfb-94d6-409c-9ab5-713deb2194a5 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.185919 Jul 15 15:54:17.563357 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 95/200] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:17 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:17.703690 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8cae9829-b21b-4ffd-a044-0154b52cbabf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:17.711354 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8cae9829-b21b-4ffd-a044-0154b52cbabf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.166079 Jul 15 15:54:17.712330 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 106/201] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:17 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:18.032554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:18.033212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:18.039187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:18.039650 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:18.040409 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:18.040983 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:18.188845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:18.198910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:18.200479 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:18.204352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-08c4cd3b-3b11-4775-bdcc-2a5826e60d54 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.173098 Jul 15 15:54:18.204352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 96/202] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:18 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:18.495653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ed1955b1-827f-4c38-8108-976f0eeced9f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:18.496361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ed1955b1-827f-4c38-8108-976f0eeced9f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:18.503099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ed1955b1-827f-4c38-8108-976f0eeced9f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:18.503587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ed1955b1-827f-4c38-8108-976f0eeced9f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:18.504362 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ed1955b1-827f-4c38-8108-976f0eeced9f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:18.504983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ed1955b1-827f-4c38-8108-976f0eeced9f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:18.578581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e823c2b8-aeea-4907-abc2-7abc0f78df2b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:18.579209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e823c2b8-aeea-4907-abc2-7abc0f78df2b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:18.587476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e823c2b8-aeea-4907-abc2-7abc0f78df2b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:18.587966 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e823c2b8-aeea-4907-abc2-7abc0f78df2b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:18.588753 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e823c2b8-aeea-4907-abc2-7abc0f78df2b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:18.589656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e823c2b8-aeea-4907-abc2-7abc0f78df2b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:18.682288 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ed1955b1-827f-4c38-8108-976f0eeced9f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:18.691124 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ed1955b1-827f-4c38-8108-976f0eeced9f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.198887 Jul 15 15:54:18.692096 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 107/203] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:18 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:18.732794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5be77b08-22b8-4f11-8a0e-e36350fc29df tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:18.733409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5be77b08-22b8-4f11-8a0e-e36350fc29df tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:18.743230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5be77b08-22b8-4f11-8a0e-e36350fc29df tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:18.743977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5be77b08-22b8-4f11-8a0e-e36350fc29df tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:18.744800 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5be77b08-22b8-4f11-8a0e-e36350fc29df tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:18.745390 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5be77b08-22b8-4f11-8a0e-e36350fc29df tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:18.809507 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e823c2b8-aeea-4907-abc2-7abc0f78df2b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:18.822845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e823c2b8-aeea-4907-abc2-7abc0f78df2b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.248255 Jul 15 15:54:18.823995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 97/204] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:18 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:19.098677 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5be77b08-22b8-4f11-8a0e-e36350fc29df tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:19.106826 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5be77b08-22b8-4f11-8a0e-e36350fc29df tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.381758 Jul 15 15:54:19.108654 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 108/205] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:18 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:19.220276 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:19.220887 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:19.224054 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:19.227507 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:19.227963 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:19.228770 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:19.229209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:19.233424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:19.321632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:19.394367 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:19.402681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:19.404361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:19.405679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-75af80bd-ace8-43ec-85f6-0c1dad420f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.189317 Jul 15 15:54:19.406877 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 98/206] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:19 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:19.711209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d00edf29-ec97-4b5f-bf56-be9dbc5d9e40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:19.712089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d00edf29-ec97-4b5f-bf56-be9dbc5d9e40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:19.719099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d00edf29-ec97-4b5f-bf56-be9dbc5d9e40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:19.719667 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d00edf29-ec97-4b5f-bf56-be9dbc5d9e40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:19.720859 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d00edf29-ec97-4b5f-bf56-be9dbc5d9e40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:19.721144 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d00edf29-ec97-4b5f-bf56-be9dbc5d9e40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:19.842488 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d970da0e-eb20-4dcb-b516-aed16f6655fa tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:19.843237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d970da0e-eb20-4dcb-b516-aed16f6655fa tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:19.851345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d970da0e-eb20-4dcb-b516-aed16f6655fa tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:19.851971 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d970da0e-eb20-4dcb-b516-aed16f6655fa tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:19.852746 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d970da0e-eb20-4dcb-b516-aed16f6655fa tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:19.853183 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d970da0e-eb20-4dcb-b516-aed16f6655fa tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:19.870744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d00edf29-ec97-4b5f-bf56-be9dbc5d9e40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:19.884450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d00edf29-ec97-4b5f-bf56-be9dbc5d9e40 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.179419 Jul 15 15:54:19.885616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 109/207] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:19 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:20.015445 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d970da0e-eb20-4dcb-b516-aed16f6655fa tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:20.022772 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d970da0e-eb20-4dcb-b516-aed16f6655fa tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.184911 Jul 15 15:54:20.023505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 99/208] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:19 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:20.123571 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-14280c06-0d4a-493e-b0be-f5f0d918e6a1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:20.124195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-14280c06-0d4a-493e-b0be-f5f0d918e6a1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:20.130430 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-14280c06-0d4a-493e-b0be-f5f0d918e6a1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:20.130890 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-14280c06-0d4a-493e-b0be-f5f0d918e6a1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:20.131688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-14280c06-0d4a-493e-b0be-f5f0d918e6a1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:20.132150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-14280c06-0d4a-493e-b0be-f5f0d918e6a1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:20.270653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-14280c06-0d4a-493e-b0be-f5f0d918e6a1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:20.278099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-14280c06-0d4a-493e-b0be-f5f0d918e6a1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.158245 Jul 15 15:54:20.278843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 110/209] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:20 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:20.423759 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:20.424384 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:20.430344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:20.430984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:20.431769 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:20.432198 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:20.567698 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:20.576675 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:20.578113 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:20.579377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fe42a9dd-ac52-45dd-b22e-568a91889e68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.159424 Jul 15 15:54:20.579935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 100/210] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:20 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:20.692750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2f9672f7-184c-472e-87e6-2b2fa790f962 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Action: 'create', calling method: .version_select at 0x7f510ae66670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1922170256", "metadata": {"Type": "work"}}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2f9672f7-184c-472e-87e6-2b2fa790f962 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Request method failure captured: Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 122 Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y2skbOR7Xvi89Tbtr5btHuPqYZBob0HovAUNXBPXX19VnqYZnRVlZG7sFe45WDjvwnXwwA7EOHgWgVQL7f9Vq3p3Pgquzx4nrM7q-dyja3ZLi43KtYDgIsHq_GU4hbFgXcg0Ox01ox6n9g9ZP6YW4DRrt4_CceQSsWg0FaZjl1ZTtI Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 15:54:20.703418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: c132cda101514dde9f5dc2f8c7e70ce2 Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1922170256", "metadata": {"Type": "work"}}} Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: Jul 15 15:54:20.710587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1922170256', 'metadata': {'Type': 'work'}}}} Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise error Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi '#$%' Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:54:20.711933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 15:54:20.713514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 15:54:20.715167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 15:54:20.715167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.715167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2f9672f7-184c-472e-87e6-2b2fa790f962 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:54:20.715167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2f9672f7-184c-472e-87e6-2b2fa790f962 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131245 Jul 15 15:54:20.715167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 111/211] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Jul 15 15:54:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 15 15:54:20.718278 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c103b229-9811-4404-950b-635bfc1eebd1 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Action: 'create', calling method: .version_select at 0x7f510ade8f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-416397809", "metadata": {"Type": "work"}}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c103b229-9811-4404-950b-635bfc1eebd1 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Request method failure captured: Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 119 Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y2skbOR7Xvi89Tbtr5btHuPqYZBob0HovAUNXBPXX19VnqYZnRVlZG7sFe45WDjvwnXwwA7EOHgWgVQL7f9Vq3p3Pgquzx4nrM7q-dyja3ZLi43KtYDgIsHq_GU4hbFgXcg0Ox01ox6n9g9ZP6YW4DRrt4_CceQSsWg0FaZjl1ZTtI Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:54:20.721872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: c132cda101514dde9f5dc2f8c7e70ce2 Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-416397809", "metadata": {"Type": "work"}}} Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: Jul 15 15:54:20.723441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-416397809', 'metadata': {'Type': 'work'}}}} Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise error Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi '0' Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:54:20.724287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 15:54:20.725793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 15:54:20.727212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 15:54:20.727212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.727212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c103b229-9811-4404-950b-635bfc1eebd1 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:54:20.727212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c103b229-9811-4404-950b-635bfc1eebd1 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012372 Jul 15 15:54:20.727927 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 101/212] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Jul 15 15:54:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:54:20.732912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-83e33874-b51b-494c-9d7b-4e5e9e019b4c tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Action: 'create', calling method: .version_select at 0x7f510ad21d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-492284496", "metadata": {"Type": "work"}}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-83e33874-b51b-494c-9d7b-4e5e9e019b4c tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Request method failure captured: Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 118 Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y2skbOR7Xvi89Tbtr5btHuPqYZBob0HovAUNXBPXX19VnqYZnRVlZG7sFe45WDjvwnXwwA7EOHgWgVQL7f9Vq3p3Pgquzx4nrM7q-dyja3ZLi43KtYDgIsHq_GU4hbFgXcg0Ox01ox6n9g9ZP6YW4DRrt4_CceQSsWg0FaZjl1ZTtI Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 15:54:20.735322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: c132cda101514dde9f5dc2f8c7e70ce2 Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-492284496", "metadata": {"Type": "work"}}} Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: Jul 15 15:54:20.736946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-492284496', 'metadata': {'Type': 'work'}}}} Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise error Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi '' Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:54:20.738201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 15:54:20.740210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 15:54:20.741785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 15:54:20.741785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.741785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-83e33874-b51b-494c-9d7b-4e5e9e019b4c tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:54:20.741785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-83e33874-b51b-494c-9d7b-4e5e9e019b4c tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007800 Jul 15 15:54:20.741785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 112/213] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Jul 15 15:54:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 15 15:54:20.748611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b47a42f4-f3fb-461b-8cf0-bc8504d0c371 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Calling method '.version_select at 0x7f510ae0e430>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:20.777379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-b47a42f4-f3fb-461b-8cf0-bc8504d0c371 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] HTTP exception thrown: Volume tempest-invalid-1604765815 could not be found. Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b47a42f4-f3fb-461b-8cf0-bc8504d0c371 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Request method failure captured: Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1604765815 HTTP/1.1 Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y2skbOR7Xvi89Tbtr5btHuPqYZBob0HovAUNXBPXX19VnqYZnRVlZG7sFe45WDjvwnXwwA7EOHgWgVQL7f9Vq3p3Pgquzx4nrM7q-dyja3ZLi43KtYDgIsHq_GU4hbFgXcg0Ox01ox6n9g9ZP6YW4DRrt4_CceQSsWg0FaZjl1ZTtI Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:54:20.780286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: c132cda101514dde9f5dc2f8c7e70ce2 Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Volume tempest-invalid-1604765815 could not be found. Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': 'tempest-invalid-1604765815'} Jul 15 15:54:20.781413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1604765815 could not be found. (HTTP 404) (Request-ID: req-c7cf97a8-208d-4b73-a8b8-0617035a33f3) Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.782136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:54:20.783124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1604765815 could not be found. Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:54:20.784155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1604765815 could not be found. Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1604765815 could not be found. Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b47a42f4-f3fb-461b-8cf0-bc8504d0c371 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Returning 404 to user: Volume tempest-invalid-1604765815 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b47a42f4-f3fb-461b-8cf0-bc8504d0c371 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1604765815" status: 404 len: 99 microversion: 2.1 time: 0.038560 Jul 15 15:54:20.785161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 102/214] 10.222.0.98 () {58 vars in 1217 bytes} [Fri Jul 15 15:54:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1604765815 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 15 15:54:20.796744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a41be74a-19bb-4e0f-a49e-478136c9690a tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005334 Jul 15 15:54:20.799314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 113/215] 10.222.0.98 () {58 vars in 1139 bytes} [Fri Jul 15 15:54:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 15:54:20.812242 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3273186a-85fe-4aca-acdf-5c9430d46d97 tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003804 Jul 15 15:54:20.812892 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 103/216] 10.222.0.98 () {58 vars in 1136 bytes} [Fri Jul 15 15:54:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 15 15:54:20.826495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-25792a4f-3372-46d1-9f97-68df2f19affc tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Calling method '.version_select at 0x7f510ad21160>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:20.860027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-25792a4f-3372-46d1-9f97-68df2f19affc tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] HTTP exception thrown: Volume 50eacfe3-6b19-499c-b65a-4ededf20237d could not be found. Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-25792a4f-3372-46d1-9f97-68df2f19affc tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Request method failure captured: Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: DELETE /compute/v2.1/os-volumes/50eacfe3-6b19-499c-b65a-4ededf20237d HTTP/1.1 Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y2skbOR7Xvi89Tbtr5btHuPqYZBob0HovAUNXBPXX19VnqYZnRVlZG7sFe45WDjvwnXwwA7EOHgWgVQL7f9Vq3p3Pgquzx4nrM7q-dyja3ZLi43KtYDgIsHq_GU4hbFgXcg0Ox01ox6n9g9ZP6YW4DRrt4_CceQSsWg0FaZjl1ZTtI Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 15:54:20.862005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: c132cda101514dde9f5dc2f8c7e70ce2 Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Volume 50eacfe3-6b19-499c-b65a-4ededf20237d could not be found. Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '50eacfe3-6b19-499c-b65a-4ededf20237d'} Jul 15 15:54:20.863464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50eacfe3-6b19-499c-b65a-4ededf20237d could not be found. (HTTP 404) (Request-ID: req-9f977194-5fa6-40a8-a438-13f5645d4208) Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.864415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:54:20.865372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50eacfe3-6b19-499c-b65a-4ededf20237d could not be found. Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 15:54:20.866391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50eacfe3-6b19-499c-b65a-4ededf20237d could not be found. Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50eacfe3-6b19-499c-b65a-4ededf20237d could not be found. Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-25792a4f-3372-46d1-9f97-68df2f19affc tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Returning 404 to user: Volume 50eacfe3-6b19-499c-b65a-4ededf20237d could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-25792a4f-3372-46d1-9f97-68df2f19affc tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/50eacfe3-6b19-499c-b65a-4ededf20237d" status: 404 len: 109 microversion: 2.1 time: 0.040795 Jul 15 15:54:20.867365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 114/217] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 15:54:20 2022] DELETE /compute/v2.1/os-volumes/50eacfe3-6b19-499c-b65a-4ededf20237d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:54:20.874432 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-41cfad76-bfd7-4387-856e-bee5d9ef916f tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Calling method '.version_select at 0x7f510ad0e1f0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:20.902053 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f695bde4-6ef9-4ba9-81f9-02d647ffe4ae tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:20.902255 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-41cfad76-bfd7-4387-856e-bee5d9ef916f tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] HTTP exception thrown: Volume 879d018c-3056-4601-a631-a7fa9bb4d086 could not be found. Jul 15 15:54:20.902393 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f695bde4-6ef9-4ba9-81f9-02d647ffe4ae tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-41cfad76-bfd7-4387-856e-bee5d9ef916f tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Request method failure captured: Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/os-volumes/879d018c-3056-4601-a631-a7fa9bb4d086 HTTP/1.1 Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y2skbOR7Xvi89Tbtr5btHuPqYZBob0HovAUNXBPXX19VnqYZnRVlZG7sFe45WDjvwnXwwA7EOHgWgVQL7f9Vq3p3Pgquzx4nrM7q-dyja3ZLi43KtYDgIsHq_GU4hbFgXcg0Ox01ox6n9g9ZP6YW4DRrt4_CceQSsWg0FaZjl1ZTtI Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:54:20.904072 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/650e9a1656a0417e844fb6c13b3fc9cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 650e9a1656a0417e844fb6c13b3fc9cf Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-VolumesNegativeTest-318991030 Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: c132cda101514dde9f5dc2f8c7e70ce2 Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-VolumesNegativeTest-318991030-project Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Volume 879d018c-3056-4601-a631-a7fa9bb4d086 could not be found. Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '879d018c-3056-4601-a631-a7fa9bb4d086'} Jul 15 15:54:20.905476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 879d018c-3056-4601-a631-a7fa9bb4d086 could not be found. (HTTP 404) (Request-ID: req-140fc1d3-7c71-4bbf-9e0b-513df715c01c) Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.906269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:54:20.907574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 879d018c-3056-4601-a631-a7fa9bb4d086 could not be found. Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 15:54:20.908742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 879d018c-3056-4601-a631-a7fa9bb4d086 could not be found. Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 879d018c-3056-4601-a631-a7fa9bb4d086 could not be found. Jul 15 15:54:20.909969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:54:20.910674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f695bde4-6ef9-4ba9-81f9-02d647ffe4ae tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:20.910674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f695bde4-6ef9-4ba9-81f9-02d647ffe4ae tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:20.911073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f695bde4-6ef9-4ba9-81f9-02d647ffe4ae tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:20.911278 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-41cfad76-bfd7-4387-856e-bee5d9ef916f tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] Returning 404 to user: Volume 879d018c-3056-4601-a631-a7fa9bb4d086 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:54:20.911584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f695bde4-6ef9-4ba9-81f9-02d647ffe4ae tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:20.912326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-41cfad76-bfd7-4387-856e-bee5d9ef916f tempest-VolumesNegativeTest-318991030 tempest-VolumesNegativeTest-318991030-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/879d018c-3056-4601-a631-a7fa9bb4d086" status: 404 len: 109 microversion: 2.1 time: 0.042328 Jul 15 15:54:20.913326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 104/218] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Jul 15 15:54:20 2022] GET /compute/v2.1/os-volumes/879d018c-3056-4601-a631-a7fa9bb4d086 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:54:21.042569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-243ea9e3-0ed0-42b2-8d37-2fd2bf2ba66e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:21.045552 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-243ea9e3-0ed0-42b2-8d37-2fd2bf2ba66e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:21.054571 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-243ea9e3-0ed0-42b2-8d37-2fd2bf2ba66e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:21.055321 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-243ea9e3-0ed0-42b2-8d37-2fd2bf2ba66e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:21.056901 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-243ea9e3-0ed0-42b2-8d37-2fd2bf2ba66e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:21.057502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-243ea9e3-0ed0-42b2-8d37-2fd2bf2ba66e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:21.081394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f695bde4-6ef9-4ba9-81f9-02d647ffe4ae tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:21.089009 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f695bde4-6ef9-4ba9-81f9-02d647ffe4ae tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.191829 Jul 15 15:54:21.090055 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 115/219] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:20 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:21.204534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-243ea9e3-0ed0-42b2-8d37-2fd2bf2ba66e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:21.212186 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-243ea9e3-0ed0-42b2-8d37-2fd2bf2ba66e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.175861 Jul 15 15:54:21.212762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 105/220] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:21 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:21.295620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-02a27310-b63f-47f2-84e6-140a810490d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:21.296246 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-02a27310-b63f-47f2-84e6-140a810490d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:21.302271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-02a27310-b63f-47f2-84e6-140a810490d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:21.302723 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-02a27310-b63f-47f2-84e6-140a810490d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:21.303570 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-02a27310-b63f-47f2-84e6-140a810490d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:21.304051 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-02a27310-b63f-47f2-84e6-140a810490d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:21.436021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-02a27310-b63f-47f2-84e6-140a810490d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:21.450685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-02a27310-b63f-47f2-84e6-140a810490d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.152930 Jul 15 15:54:21.450685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 116/221] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:21 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:21.597864 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:21.598481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:21.605219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:21.605672 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:21.606455 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:21.606889 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:21.774863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:21.783432 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:21.785009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:21.786107 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7bdc00fa-2ad1-4ead-9276-8d7be07d09fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.192678 Jul 15 15:54:21.786664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 106/222] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:21 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:22.106494 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a82ed307-67f2-49dc-b89d-8111dc1b790c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:22.107107 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a82ed307-67f2-49dc-b89d-8111dc1b790c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:22.113575 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a82ed307-67f2-49dc-b89d-8111dc1b790c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:22.114035 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a82ed307-67f2-49dc-b89d-8111dc1b790c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:22.114816 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a82ed307-67f2-49dc-b89d-8111dc1b790c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:22.115259 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a82ed307-67f2-49dc-b89d-8111dc1b790c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:22.232515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c88782b8-cd34-46bb-8ccf-5541535bfecc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:22.234186 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c88782b8-cd34-46bb-8ccf-5541535bfecc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:22.244435 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c88782b8-cd34-46bb-8ccf-5541535bfecc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:22.246242 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c88782b8-cd34-46bb-8ccf-5541535bfecc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:22.247256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c88782b8-cd34-46bb-8ccf-5541535bfecc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:22.248862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c88782b8-cd34-46bb-8ccf-5541535bfecc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:22.276698 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a82ed307-67f2-49dc-b89d-8111dc1b790c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:22.286348 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a82ed307-67f2-49dc-b89d-8111dc1b790c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.183595 Jul 15 15:54:22.286938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 117/223] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:22 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:22.391732 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c88782b8-cd34-46bb-8ccf-5541535bfecc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:22.399064 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c88782b8-cd34-46bb-8ccf-5541535bfecc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.170666 Jul 15 15:54:22.399669 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 107/224] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:22 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:22.459818 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9c00a266-a4c6-4546-ba75-ace0cd0f88ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:22.460426 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9c00a266-a4c6-4546-ba75-ace0cd0f88ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:22.466614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9c00a266-a4c6-4546-ba75-ace0cd0f88ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:22.467066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9c00a266-a4c6-4546-ba75-ace0cd0f88ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:22.467907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9c00a266-a4c6-4546-ba75-ace0cd0f88ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:22.468345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9c00a266-a4c6-4546-ba75-ace0cd0f88ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:22.601793 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9c00a266-a4c6-4546-ba75-ace0cd0f88ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:22.610060 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9c00a266-a4c6-4546-ba75-ace0cd0f88ea tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.153939 Jul 15 15:54:22.610804 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 118/225] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:22 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:22.805169 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:22.805986 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:22.812905 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:22.813398 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:22.814260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:22.814835 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:22.946340 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:22.954820 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:22.956328 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:22.957410 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9c7f55d2-29a2-4f96-b10d-31bdc00df775 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.156918 Jul 15 15:54:22.957962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 108/226] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:22 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:54:23.304756 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-058451b9-300a-45d2-8fc3-ddc8bc8ed971 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:23.306714 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-058451b9-300a-45d2-8fc3-ddc8bc8ed971 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:23.315888 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-058451b9-300a-45d2-8fc3-ddc8bc8ed971 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:23.317239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-058451b9-300a-45d2-8fc3-ddc8bc8ed971 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:23.318263 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-058451b9-300a-45d2-8fc3-ddc8bc8ed971 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:23.319513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-058451b9-300a-45d2-8fc3-ddc8bc8ed971 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:23.416176 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a1349957-cb78-4fac-b3ce-05f361024906 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:23.416791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a1349957-cb78-4fac-b3ce-05f361024906 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:23.433090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a1349957-cb78-4fac-b3ce-05f361024906 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:23.433791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a1349957-cb78-4fac-b3ce-05f361024906 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:23.434945 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a1349957-cb78-4fac-b3ce-05f361024906 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:23.436102 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a1349957-cb78-4fac-b3ce-05f361024906 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:23.500066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-058451b9-300a-45d2-8fc3-ddc8bc8ed971 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:23.509157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-058451b9-300a-45d2-8fc3-ddc8bc8ed971 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.209296 Jul 15 15:54:23.509883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 119/227] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:23 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:23.635861 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2bf235b7-0c3e-46d5-885f-0c161f7054ec tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:23.636480 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2bf235b7-0c3e-46d5-885f-0c161f7054ec tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:23.643778 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2bf235b7-0c3e-46d5-885f-0c161f7054ec tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:23.644447 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2bf235b7-0c3e-46d5-885f-0c161f7054ec tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:23.645232 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2bf235b7-0c3e-46d5-885f-0c161f7054ec tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:23.645687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2bf235b7-0c3e-46d5-885f-0c161f7054ec tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:23.777025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a1349957-cb78-4fac-b3ce-05f361024906 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:23.784885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a1349957-cb78-4fac-b3ce-05f361024906 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.372448 Jul 15 15:54:23.785887 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 109/228] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:23 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:23.796907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2bf235b7-0c3e-46d5-885f-0c161f7054ec tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:23.804839 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2bf235b7-0c3e-46d5-885f-0c161f7054ec tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.172858 Jul 15 15:54:23.805614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 120/229] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:23 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:23.974889 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:23.975553 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:23.981638 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:23.982096 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:23.983372 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:23.983810 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:24.123741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:24.132004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:24.133485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:24.134571 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-bfea5a4b-48cf-4aec-83eb-9e3d4b7fffdf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.163564 Jul 15 15:54:24.135190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 110/230] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:23 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:24.525805 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-df5f500f-695b-4541-9acb-67eda900c41c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:24.526435 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-df5f500f-695b-4541-9acb-67eda900c41c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:24.533320 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df5f500f-695b-4541-9acb-67eda900c41c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:24.533768 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df5f500f-695b-4541-9acb-67eda900c41c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:24.534538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df5f500f-695b-4541-9acb-67eda900c41c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:24.534967 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df5f500f-695b-4541-9acb-67eda900c41c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:24.672047 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-df5f500f-695b-4541-9acb-67eda900c41c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:24.679751 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-df5f500f-695b-4541-9acb-67eda900c41c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.157512 Jul 15 15:54:24.680396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 121/231] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:24 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:24.802239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6e513879-f0bd-4072-9087-231a03d3724f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:24.802872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6e513879-f0bd-4072-9087-231a03d3724f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:24.808923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e513879-f0bd-4072-9087-231a03d3724f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:24.809371 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e513879-f0bd-4072-9087-231a03d3724f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:24.810136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e513879-f0bd-4072-9087-231a03d3724f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:24.811378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e513879-f0bd-4072-9087-231a03d3724f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:24.821949 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-630f3dd7-33fd-4420-a1c5-1951f9b62c68 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:24.822558 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-630f3dd7-33fd-4420-a1c5-1951f9b62c68 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:24.828699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-630f3dd7-33fd-4420-a1c5-1951f9b62c68 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:24.829232 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-630f3dd7-33fd-4420-a1c5-1951f9b62c68 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:24.830001 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-630f3dd7-33fd-4420-a1c5-1951f9b62c68 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:24.830422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-630f3dd7-33fd-4420-a1c5-1951f9b62c68 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:24.949412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6e513879-f0bd-4072-9087-231a03d3724f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:24.957277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6e513879-f0bd-4072-9087-231a03d3724f tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.158834 Jul 15 15:54:24.957900 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 111/232] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:24 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:24.973923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-630f3dd7-33fd-4420-a1c5-1951f9b62c68 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:24.981455 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-630f3dd7-33fd-4420-a1c5-1951f9b62c68 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.163373 Jul 15 15:54:24.982099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 122/233] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:24 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:25.152229 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:25.152831 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:25.159371 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:25.159826 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:25.160709 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:25.161188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:25.292047 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:25.300666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:25.302186 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:25.303277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-787e0c4f-ddfd-4f33-abcf-35ca8e6c4254 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.154931 Jul 15 15:54:25.303851 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 112/234] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:25 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:25.696841 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7e9d4c19-755b-41ff-9acb-8a4e1db942ec tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:25.697454 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7e9d4c19-755b-41ff-9acb-8a4e1db942ec tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:25.703785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e9d4c19-755b-41ff-9acb-8a4e1db942ec tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:25.704240 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e9d4c19-755b-41ff-9acb-8a4e1db942ec tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:25.705012 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e9d4c19-755b-41ff-9acb-8a4e1db942ec tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:25.705450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e9d4c19-755b-41ff-9acb-8a4e1db942ec tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:25.834947 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7e9d4c19-755b-41ff-9acb-8a4e1db942ec tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:25.843170 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7e9d4c19-755b-41ff-9acb-8a4e1db942ec tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.150200 Jul 15 15:54:25.843775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 123/235] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:25 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:25.975427 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-57399c92-4bc7-4025-822e-390cbcaf3522 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:25.976090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-57399c92-4bc7-4025-822e-390cbcaf3522 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:25.981986 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-57399c92-4bc7-4025-822e-390cbcaf3522 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:25.982472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-57399c92-4bc7-4025-822e-390cbcaf3522 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:25.983835 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-57399c92-4bc7-4025-822e-390cbcaf3522 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:25.984262 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-57399c92-4bc7-4025-822e-390cbcaf3522 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:25.998112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5c2d5532-10da-426d-b983-70426be4056a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:25.998647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5c2d5532-10da-426d-b983-70426be4056a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:26.007248 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c2d5532-10da-426d-b983-70426be4056a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:26.007793 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c2d5532-10da-426d-b983-70426be4056a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:26.008581 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c2d5532-10da-426d-b983-70426be4056a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:26.009027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c2d5532-10da-426d-b983-70426be4056a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:26.146291 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5c2d5532-10da-426d-b983-70426be4056a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:26.156241 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5c2d5532-10da-426d-b983-70426be4056a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.161851 Jul 15 15:54:26.156945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 124/236] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:25 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:26.182817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-57399c92-4bc7-4025-822e-390cbcaf3522 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:26.185579 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-57399c92-4bc7-4025-822e-390cbcaf3522 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.214318 Jul 15 15:54:26.186157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 113/237] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:25 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:26.322197 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:26.322921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:26.330270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:26.330735 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:26.331584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:26.332028 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:26.336437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:26.504835 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:26.512673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:26.514744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:26.515903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b1043abc-5d7d-4928-8f39-7db2a24728a8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.197976 Jul 15 15:54:26.516472 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 125/238] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:26 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:26.860533 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-80b0f79c-5037-43eb-8797-c7a019751658 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:26.861134 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-80b0f79c-5037-43eb-8797-c7a019751658 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:26.867316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-80b0f79c-5037-43eb-8797-c7a019751658 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:26.867781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-80b0f79c-5037-43eb-8797-c7a019751658 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:26.868559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-80b0f79c-5037-43eb-8797-c7a019751658 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:26.868999 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-80b0f79c-5037-43eb-8797-c7a019751658 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:27.001068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-80b0f79c-5037-43eb-8797-c7a019751658 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:27.006951 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-80b0f79c-5037-43eb-8797-c7a019751658 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.150960 Jul 15 15:54:27.007555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 114/239] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:26 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:27.172636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2e0ea41b-5dd0-4c87-b9aa-aaa7a57c9ba5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:27.173253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2e0ea41b-5dd0-4c87-b9aa-aaa7a57c9ba5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:27.179185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2e0ea41b-5dd0-4c87-b9aa-aaa7a57c9ba5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:27.179666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2e0ea41b-5dd0-4c87-b9aa-aaa7a57c9ba5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:27.180434 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2e0ea41b-5dd0-4c87-b9aa-aaa7a57c9ba5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:27.180870 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2e0ea41b-5dd0-4c87-b9aa-aaa7a57c9ba5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:27.202198 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2a1c4722-4756-4bb2-bae9-b4aef8bc15e0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:27.202931 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2a1c4722-4756-4bb2-bae9-b4aef8bc15e0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:27.210117 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a1c4722-4756-4bb2-bae9-b4aef8bc15e0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:27.210707 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a1c4722-4756-4bb2-bae9-b4aef8bc15e0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:27.211613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a1c4722-4756-4bb2-bae9-b4aef8bc15e0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:27.212166 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a1c4722-4756-4bb2-bae9-b4aef8bc15e0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:27.315421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2e0ea41b-5dd0-4c87-b9aa-aaa7a57c9ba5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:27.323620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2e0ea41b-5dd0-4c87-b9aa-aaa7a57c9ba5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.155266 Jul 15 15:54:27.339924 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 126/240] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:27 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:27.398176 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2a1c4722-4756-4bb2-bae9-b4aef8bc15e0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:27.411857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2a1c4722-4756-4bb2-bae9-b4aef8bc15e0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.213650 Jul 15 15:54:27.412455 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 115/241] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:27 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:27.534530 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:27.535144 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:27.541214 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:27.541664 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:27.542434 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:27.542867 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:27.727449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:27.735462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:27.736989 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:27.738104 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d3b336ca-2921-49ca-b585-3386da5528ce tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.207605 Jul 15 15:54:27.738660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 127/242] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:27 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:28.024443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d94b8cda-9575-4b01-b1cc-9697c3f97875 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:28.028510 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d94b8cda-9575-4b01-b1cc-9697c3f97875 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:28.032417 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d94b8cda-9575-4b01-b1cc-9697c3f97875 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:28.032865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d94b8cda-9575-4b01-b1cc-9697c3f97875 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:28.033641 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d94b8cda-9575-4b01-b1cc-9697c3f97875 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:28.034103 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d94b8cda-9575-4b01-b1cc-9697c3f97875 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:28.167483 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d94b8cda-9575-4b01-b1cc-9697c3f97875 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:28.175874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d94b8cda-9575-4b01-b1cc-9697c3f97875 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.156196 Jul 15 15:54:28.176445 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 116/243] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:28 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:28.339357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7e5ab9e4-fb42-40a0-b52a-586fba8647ad tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:28.340338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7e5ab9e4-fb42-40a0-b52a-586fba8647ad tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:28.347433 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e5ab9e4-fb42-40a0-b52a-586fba8647ad tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:28.347899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e5ab9e4-fb42-40a0-b52a-586fba8647ad tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:28.348806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e5ab9e4-fb42-40a0-b52a-586fba8647ad tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:28.349244 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e5ab9e4-fb42-40a0-b52a-586fba8647ad tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:28.429531 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ea792538-b3a6-482c-af50-e97b03340c40 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:28.430228 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ea792538-b3a6-482c-af50-e97b03340c40 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:28.437055 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea792538-b3a6-482c-af50-e97b03340c40 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:28.437578 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea792538-b3a6-482c-af50-e97b03340c40 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:28.438424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea792538-b3a6-482c-af50-e97b03340c40 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:28.439060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea792538-b3a6-482c-af50-e97b03340c40 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:28.487048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7e5ab9e4-fb42-40a0-b52a-586fba8647ad tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:28.494488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7e5ab9e4-fb42-40a0-b52a-586fba8647ad tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.158960 Jul 15 15:54:28.495054 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 128/244] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:28 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:28.570207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ea792538-b3a6-482c-af50-e97b03340c40 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:28.578070 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ea792538-b3a6-482c-af50-e97b03340c40 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.152385 Jul 15 15:54:28.578636 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 117/245] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:28 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:28.755260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:28.755930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:28.762334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:28.762788 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:28.763604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:28.764045 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:28.893470 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:28.901657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:28.903165 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:28.904323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-79a958b6-2cc5-437d-8686-f22113b2b598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.153100 Jul 15 15:54:28.905381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 129/246] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:28 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:29.192759 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5b07fa7e-1923-4002-af78-da7f44759a6f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:29.193430 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5b07fa7e-1923-4002-af78-da7f44759a6f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:29.199689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b07fa7e-1923-4002-af78-da7f44759a6f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:29.200151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b07fa7e-1923-4002-af78-da7f44759a6f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:29.200974 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b07fa7e-1923-4002-af78-da7f44759a6f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:29.201917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b07fa7e-1923-4002-af78-da7f44759a6f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:29.338198 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5b07fa7e-1923-4002-af78-da7f44759a6f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:29.341957 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:29.346713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5b07fa7e-1923-4002-af78-da7f44759a6f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.157900 Jul 15 15:54:29.347275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 118/247] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:29 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:29.511081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f4873840-b469-42c0-a071-0aed2dc6b43e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:29.511729 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f4873840-b469-42c0-a071-0aed2dc6b43e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:29.518371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f4873840-b469-42c0-a071-0aed2dc6b43e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:29.518826 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f4873840-b469-42c0-a071-0aed2dc6b43e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:29.519625 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f4873840-b469-42c0-a071-0aed2dc6b43e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:29.520067 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f4873840-b469-42c0-a071-0aed2dc6b43e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:29.595476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f7ac58a3-8d43-49ed-a3da-efcc8d1864a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:29.596111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f7ac58a3-8d43-49ed-a3da-efcc8d1864a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:29.603051 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7ac58a3-8d43-49ed-a3da-efcc8d1864a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:29.603570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7ac58a3-8d43-49ed-a3da-efcc8d1864a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:29.604848 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7ac58a3-8d43-49ed-a3da-efcc8d1864a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:29.604848 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7ac58a3-8d43-49ed-a3da-efcc8d1864a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:29.738092 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f4873840-b469-42c0-a071-0aed2dc6b43e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:29.746535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f4873840-b469-42c0-a071-0aed2dc6b43e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.239163 Jul 15 15:54:29.747146 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 130/248] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:29 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:29.770731 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f7ac58a3-8d43-49ed-a3da-efcc8d1864a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:29.779049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f7ac58a3-8d43-49ed-a3da-efcc8d1864a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.187486 Jul 15 15:54:29.779762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 119/249] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:29 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:29.923229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:29.923963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:29.929941 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:29.930389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:29.931216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:29.931702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:30.063696 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:30.074149 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:30.076081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:30.077908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2ce51f99-2e4f-4074-b181-996b1a687191 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.159183 Jul 15 15:54:30.078966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 131/250] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:29 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:30.363906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f2bdecc8-0dc4-494a-9bee-236216017169 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:30.364774 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f2bdecc8-0dc4-494a-9bee-236216017169 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:30.371037 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2bdecc8-0dc4-494a-9bee-236216017169 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:30.371524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2bdecc8-0dc4-494a-9bee-236216017169 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:30.372454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2bdecc8-0dc4-494a-9bee-236216017169 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:30.372899 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2bdecc8-0dc4-494a-9bee-236216017169 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:30.507914 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f2bdecc8-0dc4-494a-9bee-236216017169 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:30.516048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f2bdecc8-0dc4-494a-9bee-236216017169 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.156335 Jul 15 15:54:30.516623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 120/251] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:30 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:30.770363 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d5781528-1196-4c92-852d-19dc9d49f330 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:30.770363 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d5781528-1196-4c92-852d-19dc9d49f330 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:30.770363 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5781528-1196-4c92-852d-19dc9d49f330 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:30.771119 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5781528-1196-4c92-852d-19dc9d49f330 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:30.771868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5781528-1196-4c92-852d-19dc9d49f330 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:30.772299 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5781528-1196-4c92-852d-19dc9d49f330 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:30.797214 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c4956114-0fcc-4160-94dc-c665803c1657 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:30.798095 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c4956114-0fcc-4160-94dc-c665803c1657 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:30.804505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c4956114-0fcc-4160-94dc-c665803c1657 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:30.805034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c4956114-0fcc-4160-94dc-c665803c1657 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:30.805916 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c4956114-0fcc-4160-94dc-c665803c1657 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:30.806575 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c4956114-0fcc-4160-94dc-c665803c1657 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:30.943797 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d5781528-1196-4c92-852d-19dc9d49f330 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:30.951723 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d5781528-1196-4c92-852d-19dc9d49f330 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.191793 Jul 15 15:54:30.952448 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 132/252] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:30 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:30.966064 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c4956114-0fcc-4160-94dc-c665803c1657 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:30.974049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c4956114-0fcc-4160-94dc-c665803c1657 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.181473 Jul 15 15:54:30.974621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 121/253] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:30 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:31.096244 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:31.096891 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:31.102862 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:31.103336 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:31.104113 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:31.104547 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:31.263051 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:31.272710 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:31.274184 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:31.275399 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0e8e6018-5efa-45d5-9c0c-c6e9e06157e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.183439 Jul 15 15:54:31.275967 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 133/254] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:31 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:31.536601 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ea6bcf7c-b1ad-446d-8a6b-c9ed6aa6a29b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:31.537620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ea6bcf7c-b1ad-446d-8a6b-c9ed6aa6a29b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:31.546006 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea6bcf7c-b1ad-446d-8a6b-c9ed6aa6a29b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:31.546470 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea6bcf7c-b1ad-446d-8a6b-c9ed6aa6a29b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:31.547327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea6bcf7c-b1ad-446d-8a6b-c9ed6aa6a29b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:31.547760 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea6bcf7c-b1ad-446d-8a6b-c9ed6aa6a29b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:31.691880 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ea6bcf7c-b1ad-446d-8a6b-c9ed6aa6a29b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:31.702199 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ea6bcf7c-b1ad-446d-8a6b-c9ed6aa6a29b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.170283 Jul 15 15:54:31.702199 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 122/255] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:31 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:31.969542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0b1b1ab0-1bd0-4c13-bfd7-b199d4626897 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:31.970153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0b1b1ab0-1bd0-4c13-bfd7-b199d4626897 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:31.979378 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ab0-1bd0-4c13-bfd7-b199d4626897 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:31.985468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ab0-1bd0-4c13-bfd7-b199d4626897 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:31.985468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ab0-1bd0-4c13-bfd7-b199d4626897 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:31.985468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ab0-1bd0-4c13-bfd7-b199d4626897 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:31.992480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-30e02d70-5bf1-4ea9-95ac-5cbe4c466903 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:31.993590 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-30e02d70-5bf1-4ea9-95ac-5cbe4c466903 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:32.000245 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-30e02d70-5bf1-4ea9-95ac-5cbe4c466903 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:32.000896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-30e02d70-5bf1-4ea9-95ac-5cbe4c466903 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:32.001688 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-30e02d70-5bf1-4ea9-95ac-5cbe4c466903 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:32.002135 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-30e02d70-5bf1-4ea9-95ac-5cbe4c466903 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:32.142777 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-30e02d70-5bf1-4ea9-95ac-5cbe4c466903 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:32.150741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-30e02d70-5bf1-4ea9-95ac-5cbe4c466903 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.162000 Jul 15 15:54:32.151351 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 123/256] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:31 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:32.281000 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0b1b1ab0-1bd0-4c13-bfd7-b199d4626897 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:32.288628 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0b1b1ab0-1bd0-4c13-bfd7-b199d4626897 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.323587 Jul 15 15:54:32.289157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 134/257] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:31 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:32.306122 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:32.306773 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:32.313043 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:32.313428 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:32.314204 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:32.314636 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:32.485570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:32.493660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:32.495282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:32.496408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2d76abc0-1186-40c3-8458-811b5e03fe94 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.205845 Jul 15 15:54:32.496973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 124/258] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:32 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:54:32.717406 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a9c93519-aebd-400e-b60b-332d65bd552d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:32.718028 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a9c93519-aebd-400e-b60b-332d65bd552d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:32.724322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a9c93519-aebd-400e-b60b-332d65bd552d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:32.724800 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a9c93519-aebd-400e-b60b-332d65bd552d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:32.725553 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a9c93519-aebd-400e-b60b-332d65bd552d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:32.725993 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a9c93519-aebd-400e-b60b-332d65bd552d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:32.862971 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a9c93519-aebd-400e-b60b-332d65bd552d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:32.870621 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a9c93519-aebd-400e-b60b-332d65bd552d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.157315 Jul 15 15:54:32.871205 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 135/259] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:32 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:33.178164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ac9e34fd-27ee-471f-aa6c-5e8ab77081c9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:33.179324 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ac9e34fd-27ee-471f-aa6c-5e8ab77081c9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:33.186444 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ac9e34fd-27ee-471f-aa6c-5e8ab77081c9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:33.186444 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ac9e34fd-27ee-471f-aa6c-5e8ab77081c9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:33.187037 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ac9e34fd-27ee-471f-aa6c-5e8ab77081c9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:33.187412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ac9e34fd-27ee-471f-aa6c-5e8ab77081c9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:33.309405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d57d5b76-6a4d-4ab5-ace4-fd3d030c3b12 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:33.310001 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d57d5b76-6a4d-4ab5-ace4-fd3d030c3b12 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:33.316617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d57d5b76-6a4d-4ab5-ace4-fd3d030c3b12 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:33.317066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d57d5b76-6a4d-4ab5-ace4-fd3d030c3b12 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:33.317839 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d57d5b76-6a4d-4ab5-ace4-fd3d030c3b12 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:33.318274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d57d5b76-6a4d-4ab5-ace4-fd3d030c3b12 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:33.320508 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ac9e34fd-27ee-471f-aa6c-5e8ab77081c9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:33.329282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ac9e34fd-27ee-471f-aa6c-5e8ab77081c9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.154865 Jul 15 15:54:33.332554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 125/260] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:33 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:33.451365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d57d5b76-6a4d-4ab5-ace4-fd3d030c3b12 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:33.459489 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d57d5b76-6a4d-4ab5-ace4-fd3d030c3b12 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.153853 Jul 15 15:54:33.460054 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 136/261] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:33 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:33.515418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:33.516027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:33.522086 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:33.522533 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:33.523300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:33.523806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:33.655979 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:33.668876 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:33.672345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:33.674405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d184e4ce-b466-4611-acc1-f9eeb96299c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.163258 Jul 15 15:54:33.683012 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 126/262] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:33 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:33.887544 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e7ae542a-454f-4473-8784-aa3389240080 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:33.888258 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e7ae542a-454f-4473-8784-aa3389240080 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:33.894508 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e7ae542a-454f-4473-8784-aa3389240080 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:33.895036 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e7ae542a-454f-4473-8784-aa3389240080 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:33.895844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e7ae542a-454f-4473-8784-aa3389240080 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:33.896283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e7ae542a-454f-4473-8784-aa3389240080 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:34.023977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e7ae542a-454f-4473-8784-aa3389240080 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:34.032260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e7ae542a-454f-4473-8784-aa3389240080 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.148505 Jul 15 15:54:34.043572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 137/263] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:33 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:34.347857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d001b251-7a30-4eef-8a1e-c2aee9521e23 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:34.348586 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d001b251-7a30-4eef-8a1e-c2aee9521e23 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:34.358700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d001b251-7a30-4eef-8a1e-c2aee9521e23 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:34.358700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d001b251-7a30-4eef-8a1e-c2aee9521e23 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:34.358700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d001b251-7a30-4eef-8a1e-c2aee9521e23 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:34.358700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d001b251-7a30-4eef-8a1e-c2aee9521e23 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:34.476869 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c8b9d024-bf9b-4ac3-b615-a21dd8962cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:34.477597 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c8b9d024-bf9b-4ac3-b615-a21dd8962cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:34.484158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8b9d024-bf9b-4ac3-b615-a21dd8962cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:34.484616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8b9d024-bf9b-4ac3-b615-a21dd8962cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:34.485385 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8b9d024-bf9b-4ac3-b615-a21dd8962cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:34.485818 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8b9d024-bf9b-4ac3-b615-a21dd8962cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:34.550373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d001b251-7a30-4eef-8a1e-c2aee9521e23 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:34.558484 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d001b251-7a30-4eef-8a1e-c2aee9521e23 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.215947 Jul 15 15:54:34.559068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 127/264] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:34 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:34.635249 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c8b9d024-bf9b-4ac3-b615-a21dd8962cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:34.644334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c8b9d024-bf9b-4ac3-b615-a21dd8962cbc tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.171440 Jul 15 15:54:34.644903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 138/265] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:34 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:34.701261 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:34.702449 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:34.708576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:34.709026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:34.709793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:34.710229 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:34.932500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:34.941240 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:34.942823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:34.944065 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8ca96065-25d8-4522-8233-b42b590ec5ca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.246696 Jul 15 15:54:34.944707 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 128/266] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:34 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:35.057899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-632de465-832c-4d73-ba14-34846aa80fd1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:35.058561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-632de465-832c-4d73-ba14-34846aa80fd1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:35.065335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-632de465-832c-4d73-ba14-34846aa80fd1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.065788 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-632de465-832c-4d73-ba14-34846aa80fd1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:35.066688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-632de465-832c-4d73-ba14-34846aa80fd1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.067125 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-632de465-832c-4d73-ba14-34846aa80fd1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:35.216323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-632de465-832c-4d73-ba14-34846aa80fd1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:35.225816 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-632de465-832c-4d73-ba14-34846aa80fd1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1319 microversion: 2.1 time: 0.171545 Jul 15 15:54:35.226389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 139/267] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:35 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:35.414349 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-dd2a7a84-109d-43ff-ada3-cc1e3963e907 req-d07ccd50-e49f-484a-909d-e631e065cd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652ce721-72c7-4314-8f15-bf94f30df443", "name": "network-vif-plugged", "status": "completed", "tag": "7734477d-4e1a-41e3-bb36-a23f41ac66aa"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:35.428685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-dd2a7a84-109d-43ff-ada3-cc1e3963e907 req-d07ccd50-e49f-484a-909d-e631e065cd85 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.428685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-dd2a7a84-109d-43ff-ada3-cc1e3963e907 req-d07ccd50-e49f-484a-909d-e631e065cd85 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:35.439013 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-dd2a7a84-109d-43ff-ada3-cc1e3963e907 req-d07ccd50-e49f-484a-909d-e631e065cd85 service nova] Creating event network-vif-plugged:7734477d-4e1a-41e3-bb36-a23f41ac66aa for instance 652ce721-72c7-4314-8f15-bf94f30df443 on hv-cinder-83587 Jul 15 15:54:35.444456 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-dd2a7a84-109d-43ff-ada3-cc1e3963e907 req-d07ccd50-e49f-484a-909d-e631e065cd85 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033500 Jul 15 15:54:35.445286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 129/268] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:35.575650 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-780c8412-c97c-4946-8505-8850b57ce5b1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:35.576380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-780c8412-c97c-4946-8505-8850b57ce5b1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:35.582990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-780c8412-c97c-4946-8505-8850b57ce5b1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.583482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-780c8412-c97c-4946-8505-8850b57ce5b1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:35.584266 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-780c8412-c97c-4946-8505-8850b57ce5b1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.584724 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-780c8412-c97c-4946-8505-8850b57ce5b1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:35.674071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ff900cb9-dae1-4afa-9cbb-fe869867637f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:35.674810 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ff900cb9-dae1-4afa-9cbb-fe869867637f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:35.684207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff900cb9-dae1-4afa-9cbb-fe869867637f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.684925 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff900cb9-dae1-4afa-9cbb-fe869867637f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:35.686842 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff900cb9-dae1-4afa-9cbb-fe869867637f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.687478 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff900cb9-dae1-4afa-9cbb-fe869867637f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:35.783996 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-780c8412-c97c-4946-8505-8850b57ce5b1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:35.798064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-780c8412-c97c-4946-8505-8850b57ce5b1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.225748 Jul 15 15:54:35.803934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 140/269] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:35 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:35.863607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ff900cb9-dae1-4afa-9cbb-fe869867637f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:35.870984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ff900cb9-dae1-4afa-9cbb-fe869867637f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.213053 Jul 15 15:54:35.871589 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 130/270] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:35 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:35.962028 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:35.962675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:35.970081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.970792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:35.971779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:35.972367 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:36.188856 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:36.192506 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:36.197644 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:36.199143 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:36.200286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1316452d-b03e-45c5-b26f-755969061ee4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.242158 Jul 15 15:54:36.200857 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 141/271] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:35 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:36.243443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bb1543f8-d303-4d54-a0a5-930e5ad1ee11 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:36.244147 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-bb1543f8-d303-4d54-a0a5-930e5ad1ee11 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:36.251050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bb1543f8-d303-4d54-a0a5-930e5ad1ee11 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:36.251600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bb1543f8-d303-4d54-a0a5-930e5ad1ee11 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:36.252373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bb1543f8-d303-4d54-a0a5-930e5ad1ee11 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:36.252870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bb1543f8-d303-4d54-a0a5-930e5ad1ee11 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:36.411103 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-bb1543f8-d303-4d54-a0a5-930e5ad1ee11 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:36.419045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-bb1543f8-d303-4d54-a0a5-930e5ad1ee11 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1513 microversion: 2.1 time: 0.179455 Jul 15 15:54:36.419662 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 131/272] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:36 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:36.436554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c182fb1f-96d9-4b8b-b376-2a847a4104a5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:36.437653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c182fb1f-96d9-4b8b-b376-2a847a4104a5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:36.443853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c182fb1f-96d9-4b8b-b376-2a847a4104a5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:36.444311 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c182fb1f-96d9-4b8b-b376-2a847a4104a5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:36.445086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c182fb1f-96d9-4b8b-b376-2a847a4104a5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:36.445523 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c182fb1f-96d9-4b8b-b376-2a847a4104a5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:36.507995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-c182fb1f-96d9-4b8b-b376-2a847a4104a5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'flavor' on Instance uuid 340a548f-e53b-443d-a606-fefe96076882 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:54:36.823620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1afca97a-48c9-4da4-83ce-dc2461b56b0b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:36.824539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1afca97a-48c9-4da4-83ce-dc2461b56b0b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:36.832279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1afca97a-48c9-4da4-83ce-dc2461b56b0b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:36.832891 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1afca97a-48c9-4da4-83ce-dc2461b56b0b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:36.833874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1afca97a-48c9-4da4-83ce-dc2461b56b0b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:36.834405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1afca97a-48c9-4da4-83ce-dc2461b56b0b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:36.919682 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c182fb1f-96d9-4b8b-b376-2a847a4104a5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882/action" status: 200 len: 32 microversion: 2.1 time: 0.485858 Jul 15 15:54:36.919682 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 142/273] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:54:36 2022] POST /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882/action => generated 32 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:54:36.929384 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2d0c6ded-a72a-43ee-b590-4880bbcbb7ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:36.930093 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2d0c6ded-a72a-43ee-b590-4880bbcbb7ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:36.937068 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d0c6ded-a72a-43ee-b590-4880bbcbb7ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:36.938325 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d0c6ded-a72a-43ee-b590-4880bbcbb7ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:36.939339 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d0c6ded-a72a-43ee-b590-4880bbcbb7ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:36.939824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d0c6ded-a72a-43ee-b590-4880bbcbb7ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:37.006586 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1afca97a-48c9-4da4-83ce-dc2461b56b0b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:37.016470 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1afca97a-48c9-4da4-83ce-dc2461b56b0b tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.197220 Jul 15 15:54:37.020847 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 132/274] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:36 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:37.022046 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ebf6a142-7a19-42fc-ba4d-ad339a549f30 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:37.022660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ebf6a142-7a19-42fc-ba4d-ad339a549f30 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:37.035221 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ebf6a142-7a19-42fc-ba4d-ad339a549f30 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:37.035726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ebf6a142-7a19-42fc-ba4d-ad339a549f30 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:37.036575 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ebf6a142-7a19-42fc-ba4d-ad339a549f30 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:37.037018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ebf6a142-7a19-42fc-ba4d-ad339a549f30 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:37.104211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2d0c6ded-a72a-43ee-b590-4880bbcbb7ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:37.112071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2d0c6ded-a72a-43ee-b590-4880bbcbb7ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.187027 Jul 15 15:54:37.112630 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 143/275] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:36 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:37.176287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ebf6a142-7a19-42fc-ba4d-ad339a549f30 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:37.187694 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ebf6a142-7a19-42fc-ba4d-ad339a549f30 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.167301 Jul 15 15:54:37.187694 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 133/276] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:37 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:37.219915 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:37.220638 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:37.227523 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:37.228265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:37.229204 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:37.229772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:37.462330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-7ec56f00-346c-489a-87d4-ea788a0e0dd8 req-40d0584b-7cc1-45a6-a7c7-91b361b6e02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3687d5cd-925a-43c4-a87e-a36664f4a2c1", "name": "network-vif-plugged", "status": "completed", "tag": "d3d2d474-04a0-4618-89b1-cf1ca09b1df1"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:37.478053 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-7ec56f00-346c-489a-87d4-ea788a0e0dd8 req-40d0584b-7cc1-45a6-a7c7-91b361b6e02e service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:37.478528 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-7ec56f00-346c-489a-87d4-ea788a0e0dd8 req-40d0584b-7cc1-45a6-a7c7-91b361b6e02e service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:37.491460 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-7ec56f00-346c-489a-87d4-ea788a0e0dd8 req-40d0584b-7cc1-45a6-a7c7-91b361b6e02e service nova] Creating event network-vif-plugged:d3d2d474-04a0-4618-89b1-cf1ca09b1df1 for instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 on hv-cinder-83587 Jul 15 15:54:37.496694 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:37.507168 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:37.508978 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-7ec56f00-346c-489a-87d4-ea788a0e0dd8 req-40d0584b-7cc1-45a6-a7c7-91b361b6e02e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050813 Jul 15 15:54:37.510684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:37.512705 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-70792d8d-6210-44a3-a89f-3b0bbe279392 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.298123 Jul 15 15:54:37.513002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 134/277] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:54:37.524709 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 144/278] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:37 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:38.037274 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-979d9452-668e-44f3-a8b7-cf41316046c6 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:38.037966 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-979d9452-668e-44f3-a8b7-cf41316046c6 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:38.044287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-979d9452-668e-44f3-a8b7-cf41316046c6 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:38.044736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-979d9452-668e-44f3-a8b7-cf41316046c6 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:38.045566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-979d9452-668e-44f3-a8b7-cf41316046c6 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:38.046004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-979d9452-668e-44f3-a8b7-cf41316046c6 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:38.130213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7366e169-b663-4d93-b15a-78097e7e005b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:38.135899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7366e169-b663-4d93-b15a-78097e7e005b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:38.142911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7366e169-b663-4d93-b15a-78097e7e005b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:38.229433 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7366e169-b663-4d93-b15a-78097e7e005b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:38.229433 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7366e169-b663-4d93-b15a-78097e7e005b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:38.229433 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7366e169-b663-4d93-b15a-78097e7e005b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:38.230865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-979d9452-668e-44f3-a8b7-cf41316046c6 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:38.230865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-979d9452-668e-44f3-a8b7-cf41316046c6 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.163894 Jul 15 15:54:38.230865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 135/279] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:38 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:38.230865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-07218b38-b587-46fa-8330-754a2d30b4af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:38.231224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-07218b38-b587-46fa-8330-754a2d30b4af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:38.231224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07218b38-b587-46fa-8330-754a2d30b4af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:38.231224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07218b38-b587-46fa-8330-754a2d30b4af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:38.231224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07218b38-b587-46fa-8330-754a2d30b4af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:38.231539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07218b38-b587-46fa-8330-754a2d30b4af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:38.296346 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7366e169-b663-4d93-b15a-78097e7e005b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:38.304595 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7366e169-b663-4d93-b15a-78097e7e005b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.178324 Jul 15 15:54:38.305488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 145/280] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:38 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:38.371460 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-07218b38-b587-46fa-8330-754a2d30b4af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:38.372395 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:38.376727 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-07218b38-b587-46fa-8330-754a2d30b4af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.177463 Jul 15 15:54:38.377298 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 136/281] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:38 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:38.531101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:38.531769 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:38.537803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:38.538252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:38.539017 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:38.539485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:38.690087 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:38.698123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:38.699636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:38.700725 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a464242d-5317-45b5-9fb7-4b756683f791 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.173540 Jul 15 15:54:38.701302 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 146/282] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:38 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:38.941283 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-9639779", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "networks": [{"uuid": "b33ee347-5a0b-4a94-a69b-b9d48b921848"}]}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:38.994625 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] validate_networks() for [('b33ee347-5a0b-4a94-a69b-b9d48b921848', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:54:39.236682 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7e6aaa8f-3d26-43fc-b390-a0ad817ddd44 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:39.237301 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7e6aaa8f-3d26-43fc-b390-a0ad817ddd44 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:39.243319 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e6aaa8f-3d26-43fc-b390-a0ad817ddd44 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.243789 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e6aaa8f-3d26-43fc-b390-a0ad817ddd44 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.244571 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e6aaa8f-3d26-43fc-b390-a0ad817ddd44 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.245001 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e6aaa8f-3d26-43fc-b390-a0ad817ddd44 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.337637 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:54:39.338171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:54:39.338748 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:54:39.339261 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:54:39.339818 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:54:39.349615 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.350168 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.351251 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.351980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.373933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Getting quotas for project 8d7726f6c7444f16ac5ea9696eacdf57. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:54:39.378755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Getting quotas for user a3efd91d94b44c6aa41087c2f017861f and project 8d7726f6c7444f16ac5ea9696eacdf57. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:54:39.384851 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7e6aaa8f-3d26-43fc-b390-a0ad817ddd44 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:39.394737 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:54:39.397184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:54:39.401460 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7e6aaa8f-3d26-43fc-b390-a0ad817ddd44 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.168604 Jul 15 15:54:39.402025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 147/283] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:39 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:39.413482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b4943c2a-5c00-4d48-b452-fd83320ee27f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:39.414070 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b4943c2a-5c00-4d48-b452-fd83320ee27f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:39.420274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b4943c2a-5c00-4d48-b452-fd83320ee27f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.420802 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b4943c2a-5c00-4d48-b452-fd83320ee27f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.421575 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b4943c2a-5c00-4d48-b452-fd83320ee27f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.422007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b4943c2a-5c00-4d48-b452-fd83320ee27f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.554329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b4943c2a-5c00-4d48-b452-fd83320ee27f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:39.557083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b2d5cfda-dd07-40d2-a0ad-4f09368901c7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620158 Jul 15 15:54:39.558228 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 137/284] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:54:39.563396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7f007115-40c0-4d48-a811-6dc2c258ca4c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:39.564001 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7f007115-40c0-4d48-a811-6dc2c258ca4c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:39.568565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b4943c2a-5c00-4d48-b452-fd83320ee27f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.165375 Jul 15 15:54:39.569361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 148/285] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:39 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:39.570364 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f007115-40c0-4d48-a811-6dc2c258ca4c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.570868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f007115-40c0-4d48-a811-6dc2c258ca4c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.571874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f007115-40c0-4d48-a811-6dc2c258ca4c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.572491 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f007115-40c0-4d48-a811-6dc2c258ca4c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.574311 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-143c377a-69ff-4f88-b565-3c42c829ff31 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:39.575146 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-143c377a-69ff-4f88-b565-3c42c829ff31 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:39.638825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-143c377a-69ff-4f88-b565-3c42c829ff31 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:39.646622 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-143c377a-69ff-4f88-b565-3c42c829ff31 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1211 microversion: 2.1 time: 0.076039 Jul 15 15:54:39.647276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 149/286] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:39 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1211 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:39.721794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:39.722640 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:39.734261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.734720 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.737647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:39.738898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:39.748040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7f007115-40c0-4d48-a811-6dc2c258ca4c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:39.761764 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7f007115-40c0-4d48-a811-6dc2c258ca4c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.202075 Jul 15 15:54:39.762802 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 138/287] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:39 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:39.884450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:39.892434 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:39.893979 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:39.895085 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0abb9d5d-8ce2-4be9-856c-aa4b7d7bde89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.180633 Jul 15 15:54:39.895692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 150/288] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:39 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:40.418000 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6f311ff7-db6e-4ead-a9e8-0630c27d6475 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:40.418635 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6f311ff7-db6e-4ead-a9e8-0630c27d6475 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:40.425904 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f311ff7-db6e-4ead-a9e8-0630c27d6475 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:40.426561 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f311ff7-db6e-4ead-a9e8-0630c27d6475 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:40.427373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f311ff7-db6e-4ead-a9e8-0630c27d6475 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:40.427802 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f311ff7-db6e-4ead-a9e8-0630c27d6475 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:40.586064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-882da5f4-1e47-44ef-85c1-4d3e54f4d380 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:40.586693 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-882da5f4-1e47-44ef-85c1-4d3e54f4d380 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:40.595221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:40.599214 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-882da5f4-1e47-44ef-85c1-4d3e54f4d380 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:40.601014 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-882da5f4-1e47-44ef-85c1-4d3e54f4d380 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:40.602077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-882da5f4-1e47-44ef-85c1-4d3e54f4d380 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:40.602525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-882da5f4-1e47-44ef-85c1-4d3e54f4d380 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:40.636279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6f311ff7-db6e-4ead-a9e8-0630c27d6475 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:40.645255 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6f311ff7-db6e-4ead-a9e8-0630c27d6475 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.231132 Jul 15 15:54:40.646083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 139/289] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:40 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:40.668550 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4f96578d-7030-44ab-a90e-774a47e30a6e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:40.669156 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4f96578d-7030-44ab-a90e-774a47e30a6e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:40.731605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4f96578d-7030-44ab-a90e-774a47e30a6e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:40.742030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4f96578d-7030-44ab-a90e-774a47e30a6e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1211 microversion: 2.1 time: 0.074915 Jul 15 15:54:40.743773 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 140/290] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:40 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:40.783512 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fe9f16ef-39be-4dd5-8ec5-bf892d76b417 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:40.784806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fe9f16ef-39be-4dd5-8ec5-bf892d76b417 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:40.785712 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-882da5f4-1e47-44ef-85c1-4d3e54f4d380 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:40.798277 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-882da5f4-1e47-44ef-85c1-4d3e54f4d380 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.211689 Jul 15 15:54:40.798277 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 151/291] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:40 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:40.798514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe9f16ef-39be-4dd5-8ec5-bf892d76b417 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:40.798514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe9f16ef-39be-4dd5-8ec5-bf892d76b417 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:40.798514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe9f16ef-39be-4dd5-8ec5-bf892d76b417 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:40.798514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe9f16ef-39be-4dd5-8ec5-bf892d76b417 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:40.913251 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:40.913865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:40.921236 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:40.921686 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:40.922466 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:40.922905 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:40.971692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fe9f16ef-39be-4dd5-8ec5-bf892d76b417 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:40.983964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fe9f16ef-39be-4dd5-8ec5-bf892d76b417 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.202380 Jul 15 15:54:40.987620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 141/292] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:40 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:41.152437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:41.164128 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:41.168110 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:41.171844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f554ff7c-1d6e-4251-a40e-935bed70b8f9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1405 microversion: 2.20 time: 0.260689 Jul 15 15:54:41.172833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 152/293] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:40 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:41.674332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-42eefe8b-dd7f-4048-95ac-c8969e318961 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:41.675222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-42eefe8b-dd7f-4048-95ac-c8969e318961 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:41.683190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42eefe8b-dd7f-4048-95ac-c8969e318961 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:41.683736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42eefe8b-dd7f-4048-95ac-c8969e318961 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:41.684724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42eefe8b-dd7f-4048-95ac-c8969e318961 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:41.685294 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42eefe8b-dd7f-4048-95ac-c8969e318961 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:41.758945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cf13b49d-8fa2-4a0e-89e5-480397093337 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:41.760486 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cf13b49d-8fa2-4a0e-89e5-480397093337 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:41.771894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf13b49d-8fa2-4a0e-89e5-480397093337 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:41.772988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf13b49d-8fa2-4a0e-89e5-480397093337 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:41.774303 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf13b49d-8fa2-4a0e-89e5-480397093337 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:41.775013 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf13b49d-8fa2-4a0e-89e5-480397093337 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:41.858346 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-42eefe8b-dd7f-4048-95ac-c8969e318961 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:41.862010 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cf13b49d-8fa2-4a0e-89e5-480397093337 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:41.866841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-42eefe8b-dd7f-4048-95ac-c8969e318961 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.197103 Jul 15 15:54:41.867451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 142/294] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:41 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:41.886019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-02f6a0fd-cb2d-4532-9120-094c0b58e12e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:41.886642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-02f6a0fd-cb2d-4532-9120-094c0b58e12e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:41.899456 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02f6a0fd-cb2d-4532-9120-094c0b58e12e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:41.901112 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02f6a0fd-cb2d-4532-9120-094c0b58e12e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:41.903058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02f6a0fd-cb2d-4532-9120-094c0b58e12e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:41.903691 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-02f6a0fd-cb2d-4532-9120-094c0b58e12e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:41.904535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cf13b49d-8fa2-4a0e-89e5-480397093337 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1215 microversion: 2.1 time: 0.151122 Jul 15 15:54:41.909595 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 153/295] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:41 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:42.002382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6845d125-81d6-41e3-8f39-a2a44b12397b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:42.003002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6845d125-81d6-41e3-8f39-a2a44b12397b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:42.011908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6845d125-81d6-41e3-8f39-a2a44b12397b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.012662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6845d125-81d6-41e3-8f39-a2a44b12397b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.013807 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6845d125-81d6-41e3-8f39-a2a44b12397b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.015080 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6845d125-81d6-41e3-8f39-a2a44b12397b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.169101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6845d125-81d6-41e3-8f39-a2a44b12397b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:42.177798 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6845d125-81d6-41e3-8f39-a2a44b12397b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.180231 Jul 15 15:54:42.192200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 154/296] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:41 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:42.197406 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:42.199787 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:42.206612 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.207325 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.208310 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.209590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.400534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:42.432692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:42.434451 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:42.437831 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b69086d4-4a1f-4f6a-84e2-2ed9d4fedeca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1598 microversion: 2.20 time: 0.242387 Jul 15 15:54:42.446626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 155/297] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:54:42 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1598 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:54:42.447016 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-02f6a0fd-cb2d-4532-9120-094c0b58e12e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:42.457940 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-02f6a0fd-cb2d-4532-9120-094c0b58e12e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.589249 Jul 15 15:54:42.458962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 143/298] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:41 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:42.475983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d45291c1-6005-4355-ab0b-7c97554ba687 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:42.476480 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d45291c1-6005-4355-ab0b-7c97554ba687 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:42.483453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d45291c1-6005-4355-ab0b-7c97554ba687 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.483913 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d45291c1-6005-4355-ab0b-7c97554ba687 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.484708 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d45291c1-6005-4355-ab0b-7c97554ba687 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.485683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d45291c1-6005-4355-ab0b-7c97554ba687 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.603337 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d45291c1-6005-4355-ab0b-7c97554ba687 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.139719 Jul 15 15:54:42.604140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 156/299] 10.222.0.98 () {60 vars in 1315 bytes} [Fri Jul 15 15:54:42 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:54:42.887608 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-be3a2cc9-7eb1-4128-a943-4593dbc88be2 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:42.888161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-be3a2cc9-7eb1-4128-a943-4593dbc88be2 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:42.901377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:42.901377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-be3a2cc9-7eb1-4128-a943-4593dbc88be2 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.901377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-be3a2cc9-7eb1-4128-a943-4593dbc88be2 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.901377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-be3a2cc9-7eb1-4128-a943-4593dbc88be2 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.901721 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-be3a2cc9-7eb1-4128-a943-4593dbc88be2 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.924635 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-27a87100-0809-4cec-b311-216f91385534 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:42.925253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-27a87100-0809-4cec-b311-216f91385534 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:42.939453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27a87100-0809-4cec-b311-216f91385534 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.939926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27a87100-0809-4cec-b311-216f91385534 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:42.940767 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27a87100-0809-4cec-b311-216f91385534 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:42.941210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27a87100-0809-4cec-b311-216f91385534 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:43.102115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-27a87100-0809-4cec-b311-216f91385534 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:43.115747 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:43.115747 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-27a87100-0809-4cec-b311-216f91385534 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1263 microversion: 2.1 time: 0.193567 Jul 15 15:54:43.126252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 157/300] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:42 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1263 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:43.172206 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-be3a2cc9-7eb1-4128-a943-4593dbc88be2 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:43.181460 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-be3a2cc9-7eb1-4128-a943-4593dbc88be2 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1315 microversion: 2.1 time: 0.300452 Jul 15 15:54:43.183345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 144/301] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:42 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:43.199083 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1daa47e8-7ae5-44c8-84e7-bb566b316f78 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:43.200240 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1daa47e8-7ae5-44c8-84e7-bb566b316f78 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:43.210613 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1daa47e8-7ae5-44c8-84e7-bb566b316f78 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:43.211699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1daa47e8-7ae5-44c8-84e7-bb566b316f78 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:43.212672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1daa47e8-7ae5-44c8-84e7-bb566b316f78 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:43.213315 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1daa47e8-7ae5-44c8-84e7-bb566b316f78 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:43.487356 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3d82f47c-e6ce-4894-8aef-7c2ad1a551d4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:43.488223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3d82f47c-e6ce-4894-8aef-7c2ad1a551d4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:43.497430 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3d82f47c-e6ce-4894-8aef-7c2ad1a551d4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:43.497893 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3d82f47c-e6ce-4894-8aef-7c2ad1a551d4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:43.499249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3d82f47c-e6ce-4894-8aef-7c2ad1a551d4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:43.499734 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3d82f47c-e6ce-4894-8aef-7c2ad1a551d4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:43.657350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3d82f47c-e6ce-4894-8aef-7c2ad1a551d4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:43.657551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1daa47e8-7ae5-44c8-84e7-bb566b316f78 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:43.659358 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3d82f47c-e6ce-4894-8aef-7c2ad1a551d4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.178374 Jul 15 15:54:43.661146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 145/302] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:43 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:43.664249 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1daa47e8-7ae5-44c8-84e7-bb566b316f78 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.469562 Jul 15 15:54:43.671924 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 158/303] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:43 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:44.132579 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-040cea35-f3d8-49aa-a215-aab56d899460 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:44.133276 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-040cea35-f3d8-49aa-a215-aab56d899460 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:44.139472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-040cea35-f3d8-49aa-a215-aab56d899460 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.139999 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-040cea35-f3d8-49aa-a215-aab56d899460 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:44.140839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-040cea35-f3d8-49aa-a215-aab56d899460 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.141345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-040cea35-f3d8-49aa-a215-aab56d899460 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:44.201849 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b9b276ad-d767-4579-a365-77bc85f6fab9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:44.202470 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b9b276ad-d767-4579-a365-77bc85f6fab9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:44.209525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b9b276ad-d767-4579-a365-77bc85f6fab9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.210183 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b9b276ad-d767-4579-a365-77bc85f6fab9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:44.211118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b9b276ad-d767-4579-a365-77bc85f6fab9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.211734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b9b276ad-d767-4579-a365-77bc85f6fab9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:44.287874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-040cea35-f3d8-49aa-a215-aab56d899460 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:44.298580 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-040cea35-f3d8-49aa-a215-aab56d899460 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1263 microversion: 2.1 time: 0.170021 Jul 15 15:54:44.303340 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 146/304] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:44 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:44.488164 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b9b276ad-d767-4579-a365-77bc85f6fab9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:44.496915 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b9b276ad-d767-4579-a365-77bc85f6fab9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1503 microversion: 2.1 time: 0.298858 Jul 15 15:54:44.510218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 159/305] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:44 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:44.678568 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cb51a415-bb7d-4d49-89b8-cf85eb225019 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:44.679194 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cb51a415-bb7d-4d49-89b8-cf85eb225019 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:44.700966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb51a415-bb7d-4d49-89b8-cf85eb225019 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.702304 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb51a415-bb7d-4d49-89b8-cf85eb225019 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:44.704745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb51a415-bb7d-4d49-89b8-cf85eb225019 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.705373 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb51a415-bb7d-4d49-89b8-cf85eb225019 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:44.713086 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-7ec4eee8-69c6-4d8d-a290-1d245bef785e req-84cd9b4c-963c-4d87-83c7-930118410902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652ce721-72c7-4314-8f15-bf94f30df443", "tag": "7734477d-4e1a-41e3-bb36-a23f41ac66aa"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:44.735219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-7ec4eee8-69c6-4d8d-a290-1d245bef785e req-84cd9b4c-963c-4d87-83c7-930118410902 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.739327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-7ec4eee8-69c6-4d8d-a290-1d245bef785e req-84cd9b4c-963c-4d87-83c7-930118410902 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:44.793259 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-7ec4eee8-69c6-4d8d-a290-1d245bef785e req-84cd9b4c-963c-4d87-83c7-930118410902 service nova] Creating event network-changed:7734477d-4e1a-41e3-bb36-a23f41ac66aa for instance 652ce721-72c7-4314-8f15-bf94f30df443 on hv-cinder-83587 Jul 15 15:54:44.818713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-7ec4eee8-69c6-4d8d-a290-1d245bef785e req-84cd9b4c-963c-4d87-83c7-930118410902 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215154 Jul 15 15:54:44.819605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 147/306] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:54:44.841420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3cbab1ec-4b83-4e48-8da7-961e57cc660a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:44.842136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3cbab1ec-4b83-4e48-8da7-961e57cc660a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:44.851769 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3cbab1ec-4b83-4e48-8da7-961e57cc660a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.852237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3cbab1ec-4b83-4e48-8da7-961e57cc660a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:44.853032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3cbab1ec-4b83-4e48-8da7-961e57cc660a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:44.854237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3cbab1ec-4b83-4e48-8da7-961e57cc660a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:45.028185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cb51a415-bb7d-4d49-89b8-cf85eb225019 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:45.042302 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cb51a415-bb7d-4d49-89b8-cf85eb225019 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.367814 Jul 15 15:54:45.046385 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 160/307] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:44 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:45.142293 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-a1495503-e4e0-49c9-aa0e-7f2335d0eb9c req-8f42e9c5-a171-4c36-8677-963713f50c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d25c85d-d076-40e3-81e3-1a9c6a6a1968", "name": "network-vif-plugged", "status": "completed", "tag": "fa7b9eab-9027-4963-9a6c-667aa25aa523"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:45.161438 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a1495503-e4e0-49c9-aa0e-7f2335d0eb9c req-8f42e9c5-a171-4c36-8677-963713f50c2a service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:45.163901 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a1495503-e4e0-49c9-aa0e-7f2335d0eb9c req-8f42e9c5-a171-4c36-8677-963713f50c2a service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:45.194445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-a1495503-e4e0-49c9-aa0e-7f2335d0eb9c req-8f42e9c5-a171-4c36-8677-963713f50c2a service nova] Creating event network-vif-plugged:fa7b9eab-9027-4963-9a6c-667aa25aa523 for instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 on hv-cinder-83587 Jul 15 15:54:45.209733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-a1495503-e4e0-49c9-aa0e-7f2335d0eb9c req-8f42e9c5-a171-4c36-8677-963713f50c2a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071808 Jul 15 15:54:45.210689 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 161/308] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:45.315580 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-09779e1d-4192-4ce2-9ab6-194a24fa8747 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:45.317072 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-09779e1d-4192-4ce2-9ab6-194a24fa8747 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:45.332610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-09779e1d-4192-4ce2-9ab6-194a24fa8747 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:45.334227 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-09779e1d-4192-4ce2-9ab6-194a24fa8747 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:45.337595 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-09779e1d-4192-4ce2-9ab6-194a24fa8747 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:45.339498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-09779e1d-4192-4ce2-9ab6-194a24fa8747 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:45.551087 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-09779e1d-4192-4ce2-9ab6-194a24fa8747 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:45.564362 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-09779e1d-4192-4ce2-9ab6-194a24fa8747 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1281 microversion: 2.1 time: 0.253504 Jul 15 15:54:45.574894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 162/309] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:45 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1281 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:45.625694 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3cbab1ec-4b83-4e48-8da7-961e57cc660a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:45.650507 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3cbab1ec-4b83-4e48-8da7-961e57cc660a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.825147 Jul 15 15:54:45.651748 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 148/310] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:44 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:46.067355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b303f61e-5a4e-4621-ac86-06c0ed433c36 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:46.069034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b303f61e-5a4e-4621-ac86-06c0ed433c36 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:46.080473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b303f61e-5a4e-4621-ac86-06c0ed433c36 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:46.083932 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b303f61e-5a4e-4621-ac86-06c0ed433c36 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:46.088028 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b303f61e-5a4e-4621-ac86-06c0ed433c36 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:46.088485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b303f61e-5a4e-4621-ac86-06c0ed433c36 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:46.251246 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b303f61e-5a4e-4621-ac86-06c0ed433c36 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:46.258840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b303f61e-5a4e-4621-ac86-06c0ed433c36 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.195824 Jul 15 15:54:46.259440 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 163/311] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:46 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:46.581248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-75719362-8964-43d1-b3bb-8bffe878e0fb tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:46.581862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-75719362-8964-43d1-b3bb-8bffe878e0fb tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:46.587949 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75719362-8964-43d1-b3bb-8bffe878e0fb tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:46.588401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75719362-8964-43d1-b3bb-8bffe878e0fb tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:46.593404 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75719362-8964-43d1-b3bb-8bffe878e0fb tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:46.593404 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75719362-8964-43d1-b3bb-8bffe878e0fb tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:46.673053 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c78d80bb-afcc-4509-8351-242341163428 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:46.673647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c78d80bb-afcc-4509-8351-242341163428 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:46.680089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c78d80bb-afcc-4509-8351-242341163428 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:46.680547 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c78d80bb-afcc-4509-8351-242341163428 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:46.681329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c78d80bb-afcc-4509-8351-242341163428 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:46.681764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c78d80bb-afcc-4509-8351-242341163428 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:46.730479 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-75719362-8964-43d1-b3bb-8bffe878e0fb tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:46.738292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-75719362-8964-43d1-b3bb-8bffe878e0fb tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.161354 Jul 15 15:54:46.747652 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 149/312] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:46 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:47.077623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c78d80bb-afcc-4509-8351-242341163428 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:47.085934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c78d80bb-afcc-4509-8351-242341163428 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.416880 Jul 15 15:54:47.086517 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 164/313] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:46 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:47.284387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b80ecd6f-e320-473b-8ff6-55b145aada03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:47.285074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b80ecd6f-e320-473b-8ff6-55b145aada03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:47.292064 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b80ecd6f-e320-473b-8ff6-55b145aada03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:47.292810 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b80ecd6f-e320-473b-8ff6-55b145aada03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:47.293625 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b80ecd6f-e320-473b-8ff6-55b145aada03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:47.294063 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b80ecd6f-e320-473b-8ff6-55b145aada03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:47.447435 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b80ecd6f-e320-473b-8ff6-55b145aada03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:47.456276 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b80ecd6f-e320-473b-8ff6-55b145aada03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.176738 Jul 15 15:54:47.456855 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 150/314] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:47 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:47.750110 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-432c694e-1466-4870-8743-1036adf5696e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58a8cc65-f6b1-4841-af51-541503261b78"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:47.751166 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-432c694e-1466-4870-8743-1036adf5696e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:47.757546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-432c694e-1466-4870-8743-1036adf5696e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:47.757948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9e92d46e-f92f-44cc-8193-06f8a8dc5bd0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:47.758459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-432c694e-1466-4870-8743-1036adf5696e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:47.758552 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9e92d46e-f92f-44cc-8193-06f8a8dc5bd0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:47.758742 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-432c694e-1466-4870-8743-1036adf5696e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:47.759177 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-432c694e-1466-4870-8743-1036adf5696e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:47.765331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e92d46e-f92f-44cc-8193-06f8a8dc5bd0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:47.766756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e92d46e-f92f-44cc-8193-06f8a8dc5bd0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:47.766756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e92d46e-f92f-44cc-8193-06f8a8dc5bd0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:47.767524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e92d46e-f92f-44cc-8193-06f8a8dc5bd0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:47.968448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9e92d46e-f92f-44cc-8193-06f8a8dc5bd0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:47.975866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9e92d46e-f92f-44cc-8193-06f8a8dc5bd0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.221814 Jul 15 15:54:47.976521 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 151/315] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:47 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:47.981527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-4e436d9a-27b3-4c25-87a8-204ca0a5013f req-30967164-53cd-4b43-843c-87791aff66a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67042be1-b8b2-471c-a64e-3819e5ed463a", "tag": "461555b5-6e53-43f4-a1ea-2f0fff27f356"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:47.991966 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-4e436d9a-27b3-4c25-87a8-204ca0a5013f req-30967164-53cd-4b43-843c-87791aff66a6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:47.992418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-4e436d9a-27b3-4c25-87a8-204ca0a5013f req-30967164-53cd-4b43-843c-87791aff66a6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:48.004451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-4e436d9a-27b3-4c25-87a8-204ca0a5013f req-30967164-53cd-4b43-843c-87791aff66a6 service nova] Creating event network-changed:461555b5-6e53-43f4-a1ea-2f0fff27f356 for instance 67042be1-b8b2-471c-a64e-3819e5ed463a on hv-cinder-83587 Jul 15 15:54:48.009738 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-4e436d9a-27b3-4c25-87a8-204ca0a5013f req-30967164-53cd-4b43-843c-87791aff66a6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032096 Jul 15 15:54:48.010342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 152/316] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:48.104153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7f79ed0e-d6ad-48cf-b042-a47a27c933b0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:48.104941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7f79ed0e-d6ad-48cf-b042-a47a27c933b0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:48.112498 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f79ed0e-d6ad-48cf-b042-a47a27c933b0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:48.112953 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f79ed0e-d6ad-48cf-b042-a47a27c933b0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:48.113722 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f79ed0e-d6ad-48cf-b042-a47a27c933b0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:48.114197 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f79ed0e-d6ad-48cf-b042-a47a27c933b0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:48.266306 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7f79ed0e-d6ad-48cf-b042-a47a27c933b0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:48.273819 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7f79ed0e-d6ad-48cf-b042-a47a27c933b0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.173847 Jul 15 15:54:48.274417 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 153/317] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:48 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:48.473378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-465516d5-5f27-4601-87db-78fc8a4a30af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:48.473990 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-465516d5-5f27-4601-87db-78fc8a4a30af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:48.480136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-465516d5-5f27-4601-87db-78fc8a4a30af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:48.480587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-465516d5-5f27-4601-87db-78fc8a4a30af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:48.481352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-465516d5-5f27-4601-87db-78fc8a4a30af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:48.481844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-465516d5-5f27-4601-87db-78fc8a4a30af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:48.682756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-465516d5-5f27-4601-87db-78fc8a4a30af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:48.690632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-465516d5-5f27-4601-87db-78fc8a4a30af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1361 microversion: 2.1 time: 0.221078 Jul 15 15:54:48.692323 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 154/318] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:48 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:48.994225 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-df3a5746-59ba-4528-8881-8f7bb70fcf37 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:48.994865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-df3a5746-59ba-4528-8881-8f7bb70fcf37 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:49.000843 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-df3a5746-59ba-4528-8881-8f7bb70fcf37 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:49.001285 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-df3a5746-59ba-4528-8881-8f7bb70fcf37 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:49.002385 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-df3a5746-59ba-4528-8881-8f7bb70fcf37 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:49.002826 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-df3a5746-59ba-4528-8881-8f7bb70fcf37 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:49.137993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-df3a5746-59ba-4528-8881-8f7bb70fcf37 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:49.146023 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-df3a5746-59ba-4528-8881-8f7bb70fcf37 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.155552 Jul 15 15:54:49.146587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 155/319] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:48 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:49.291193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a751ae12-ecf1-48ab-9d77-bd7fbd818ad1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:49.291956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a751ae12-ecf1-48ab-9d77-bd7fbd818ad1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:49.298489 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a751ae12-ecf1-48ab-9d77-bd7fbd818ad1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:49.299036 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a751ae12-ecf1-48ab-9d77-bd7fbd818ad1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:49.299912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a751ae12-ecf1-48ab-9d77-bd7fbd818ad1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:49.300422 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a751ae12-ecf1-48ab-9d77-bd7fbd818ad1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:49.320007 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:49.363348 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:49.392300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-432c694e-1466-4870-8743-1036adf5696e tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "POST /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.646443 Jul 15 15:54:49.393260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 165/320] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 15:54:47 2022] POST /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1/os-volume_attachments => generated 194 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:49.443054 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a751ae12-ecf1-48ab-9d77-bd7fbd818ad1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:49.453526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a751ae12-ecf1-48ab-9d77-bd7fbd818ad1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.166140 Jul 15 15:54:49.457476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 156/321] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:49 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:54:49.705899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:49.710015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d363fc3c-bbe1-4023-ad0a-ab48c0a48af0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:49.710788 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d363fc3c-bbe1-4023-ad0a-ab48c0a48af0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:49.717610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d363fc3c-bbe1-4023-ad0a-ab48c0a48af0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:49.718066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d363fc3c-bbe1-4023-ad0a-ab48c0a48af0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:49.718848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d363fc3c-bbe1-4023-ad0a-ab48c0a48af0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:49.719286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d363fc3c-bbe1-4023-ad0a-ab48c0a48af0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:49.995907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d363fc3c-bbe1-4023-ad0a-ab48c0a48af0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:50.004352 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d363fc3c-bbe1-4023-ad0a-ab48c0a48af0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1547 microversion: 2.1 time: 0.299380 Jul 15 15:54:50.004919 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 166/322] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:49 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1547 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:50.021956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8cfe5853-df7c-4e9d-a5a2-5dcca42c3f41 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:50.022481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8cfe5853-df7c-4e9d-a5a2-5dcca42c3f41 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:50.028846 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5853-df7c-4e9d-a5a2-5dcca42c3f41 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:50.029303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5853-df7c-4e9d-a5a2-5dcca42c3f41 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:50.030123 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5853-df7c-4e9d-a5a2-5dcca42c3f41 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:50.030560 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5853-df7c-4e9d-a5a2-5dcca42c3f41 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:50.154088 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8cfe5853-df7c-4e9d-a5a2-5dcca42c3f41 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135912 Jul 15 15:54:50.154714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 157/323] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Jul 15 15:54:50 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:50.162073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f67a5b70-b5b2-413c-85ee-6efb0bff8b9a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:50.162759 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f67a5b70-b5b2-413c-85ee-6efb0bff8b9a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:50.169054 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f67a5b70-b5b2-413c-85ee-6efb0bff8b9a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:50.169617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f67a5b70-b5b2-413c-85ee-6efb0bff8b9a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:50.171138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f67a5b70-b5b2-413c-85ee-6efb0bff8b9a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:50.171675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f67a5b70-b5b2-413c-85ee-6efb0bff8b9a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:50.339577 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f67a5b70-b5b2-413c-85ee-6efb0bff8b9a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:50.347588 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f67a5b70-b5b2-413c-85ee-6efb0bff8b9a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.189233 Jul 15 15:54:50.350345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 167/324] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:50 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:50.470565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ec1e93be-6ce0-406d-a57c-67de635a0774 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:50.471337 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ec1e93be-6ce0-406d-a57c-67de635a0774 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:50.484364 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ec1e93be-6ce0-406d-a57c-67de635a0774 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:50.485015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ec1e93be-6ce0-406d-a57c-67de635a0774 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:50.485811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ec1e93be-6ce0-406d-a57c-67de635a0774 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:50.486258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ec1e93be-6ce0-406d-a57c-67de635a0774 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:50.735258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=8 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:51.072847 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ec1e93be-6ce0-406d-a57c-67de635a0774 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:51.082002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ec1e93be-6ce0-406d-a57c-67de635a0774 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.615720 Jul 15 15:54:51.082803 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 158/325] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:50 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:51.373895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6afe23bc-0aba-4fe2-b1d4-2065bbb53fb6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:51.376014 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6afe23bc-0aba-4fe2-b1d4-2065bbb53fb6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:51.381430 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6afe23bc-0aba-4fe2-b1d4-2065bbb53fb6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:51.381992 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6afe23bc-0aba-4fe2-b1d4-2065bbb53fb6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:51.382839 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6afe23bc-0aba-4fe2-b1d4-2065bbb53fb6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:51.383370 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6afe23bc-0aba-4fe2-b1d4-2065bbb53fb6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:51.528569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6afe23bc-0aba-4fe2-b1d4-2065bbb53fb6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:51.536253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6afe23bc-0aba-4fe2-b1d4-2065bbb53fb6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.166226 Jul 15 15:54:51.546025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 168/326] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:51 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:51.724832 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-a8946eb8-56c1-4d31-9a19-71966c376985 req-648a544d-2cb3-46b8-a95e-311d3c258cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d25c85d-d076-40e3-81e3-1a9c6a6a1968", "tag": "fa7b9eab-9027-4963-9a6c-667aa25aa523"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:51.734090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-a8946eb8-56c1-4d31-9a19-71966c376985 req-648a544d-2cb3-46b8-a95e-311d3c258cc5 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:51.734652 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-a8946eb8-56c1-4d31-9a19-71966c376985 req-648a544d-2cb3-46b8-a95e-311d3c258cc5 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:51.746692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-a8946eb8-56c1-4d31-9a19-71966c376985 req-648a544d-2cb3-46b8-a95e-311d3c258cc5 service nova] Creating event network-changed:fa7b9eab-9027-4963-9a6c-667aa25aa523 for instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 on hv-cinder-83587 Jul 15 15:54:51.752792 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-a8946eb8-56c1-4d31-9a19-71966c376985 req-648a544d-2cb3-46b8-a95e-311d3c258cc5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031624 Jul 15 15:54:51.753404 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 159/327] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:52.101625 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-00bade02-c4ce-4224-9925-848be65826c6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:52.102240 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-00bade02-c4ce-4224-9925-848be65826c6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:52.116836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00bade02-c4ce-4224-9925-848be65826c6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:52.121297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00bade02-c4ce-4224-9925-848be65826c6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:52.121297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00bade02-c4ce-4224-9925-848be65826c6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:52.121297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00bade02-c4ce-4224-9925-848be65826c6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:52.376743 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-00bade02-c4ce-4224-9925-848be65826c6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:52.416441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-00bade02-c4ce-4224-9925-848be65826c6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.320663 Jul 15 15:54:52.417238 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 169/328] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:52 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:52.553627 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-31a8d248-a256-4d90-89cf-1d30fdebc8fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:52.554461 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-31a8d248-a256-4d90-89cf-1d30fdebc8fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:52.560828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31a8d248-a256-4d90-89cf-1d30fdebc8fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:52.561280 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31a8d248-a256-4d90-89cf-1d30fdebc8fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:52.562062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31a8d248-a256-4d90-89cf-1d30fdebc8fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:52.562502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31a8d248-a256-4d90-89cf-1d30fdebc8fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:52.855511 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-31a8d248-a256-4d90-89cf-1d30fdebc8fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:52.864695 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-31a8d248-a256-4d90-89cf-1d30fdebc8fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.315450 Jul 15 15:54:52.875147 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 160/329] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:52 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:53.433649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fa3cb083-7dda-48b2-8eec-499963f0cf50 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:53.434087 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fa3cb083-7dda-48b2-8eec-499963f0cf50 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:53.440745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fa3cb083-7dda-48b2-8eec-499963f0cf50 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:53.453201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fa3cb083-7dda-48b2-8eec-499963f0cf50 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:53.453201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fa3cb083-7dda-48b2-8eec-499963f0cf50 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:53.453201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fa3cb083-7dda-48b2-8eec-499963f0cf50 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:53.579702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fa3cb083-7dda-48b2-8eec-499963f0cf50 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:53.588011 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fa3cb083-7dda-48b2-8eec-499963f0cf50 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.158673 Jul 15 15:54:53.588584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 170/330] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:53 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:53.882506 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3103952e-7447-40a4-b9b5-e208eec99cb2 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:53.883111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3103952e-7447-40a4-b9b5-e208eec99cb2 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:53.889970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3103952e-7447-40a4-b9b5-e208eec99cb2 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:53.890348 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3103952e-7447-40a4-b9b5-e208eec99cb2 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:53.891129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3103952e-7447-40a4-b9b5-e208eec99cb2 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:53.891630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3103952e-7447-40a4-b9b5-e208eec99cb2 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:54.035307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3103952e-7447-40a4-b9b5-e208eec99cb2 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:54.041488 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3103952e-7447-40a4-b9b5-e208eec99cb2 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.162812 Jul 15 15:54:54.042067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 161/331] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:53 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:54.605999 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a3b69922-e60c-46ff-95ec-f52df5c83d1b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:54.606650 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a3b69922-e60c-46ff-95ec-f52df5c83d1b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:54.613565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a3b69922-e60c-46ff-95ec-f52df5c83d1b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:54.614017 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a3b69922-e60c-46ff-95ec-f52df5c83d1b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:54.614795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a3b69922-e60c-46ff-95ec-f52df5c83d1b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:54.615224 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a3b69922-e60c-46ff-95ec-f52df5c83d1b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:54.743526 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a3b69922-e60c-46ff-95ec-f52df5c83d1b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:54.752239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a3b69922-e60c-46ff-95ec-f52df5c83d1b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.150203 Jul 15 15:54:54.752966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 171/332] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:54 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:55.058185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ac73c164-8c70-4d0a-a34a-07a42ed1c798 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:55.058815 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ac73c164-8c70-4d0a-a34a-07a42ed1c798 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:55.064820 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ac73c164-8c70-4d0a-a34a-07a42ed1c798 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:55.065282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ac73c164-8c70-4d0a-a34a-07a42ed1c798 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:55.066030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ac73c164-8c70-4d0a-a34a-07a42ed1c798 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:55.066462 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ac73c164-8c70-4d0a-a34a-07a42ed1c798 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:55.200279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ac73c164-8c70-4d0a-a34a-07a42ed1c798 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:55.207861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ac73c164-8c70-4d0a-a34a-07a42ed1c798 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.153536 Jul 15 15:54:55.208448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 162/333] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:55 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:55.769948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8bfc55f0-3457-478f-ae64-cd64a0972135 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:55.770664 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8bfc55f0-3457-478f-ae64-cd64a0972135 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:55.777845 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8bfc55f0-3457-478f-ae64-cd64a0972135 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:55.778840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8bfc55f0-3457-478f-ae64-cd64a0972135 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:55.779381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8bfc55f0-3457-478f-ae64-cd64a0972135 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:55.779929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8bfc55f0-3457-478f-ae64-cd64a0972135 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:55.917948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8bfc55f0-3457-478f-ae64-cd64a0972135 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:55.925466 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8bfc55f0-3457-478f-ae64-cd64a0972135 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.159735 Jul 15 15:54:55.926030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 172/334] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:55 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:56.224867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b43b5058-7123-473b-b9bb-9db22f15cc01 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:56.225477 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b43b5058-7123-473b-b9bb-9db22f15cc01 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:56.231448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b43b5058-7123-473b-b9bb-9db22f15cc01 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:56.231897 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b43b5058-7123-473b-b9bb-9db22f15cc01 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:56.233170 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b43b5058-7123-473b-b9bb-9db22f15cc01 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:56.233604 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b43b5058-7123-473b-b9bb-9db22f15cc01 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:56.382188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b43b5058-7123-473b-b9bb-9db22f15cc01 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:56.398293 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b43b5058-7123-473b-b9bb-9db22f15cc01 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.176897 Jul 15 15:54:56.410009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 163/335] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:56 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:56.941706 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dde24836-b046-4bf7-888b-03e2ba50e3bb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:56.942322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-dde24836-b046-4bf7-888b-03e2ba50e3bb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:56.948802 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dde24836-b046-4bf7-888b-03e2ba50e3bb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:56.949259 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dde24836-b046-4bf7-888b-03e2ba50e3bb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:56.950089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dde24836-b046-4bf7-888b-03e2ba50e3bb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:56.950513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dde24836-b046-4bf7-888b-03e2ba50e3bb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:57.080008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dde24836-b046-4bf7-888b-03e2ba50e3bb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:57.083654 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:57.087929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dde24836-b046-4bf7-888b-03e2ba50e3bb tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.150019 Jul 15 15:54:57.088491 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 173/336] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:56 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:57.417300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-95bd9f8d-d39d-4c1d-b9a2-2277f4cd4086 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:57.417904 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-95bd9f8d-d39d-4c1d-b9a2-2277f4cd4086 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:57.424092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-95bd9f8d-d39d-4c1d-b9a2-2277f4cd4086 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:57.424513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-95bd9f8d-d39d-4c1d-b9a2-2277f4cd4086 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:57.430166 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-95bd9f8d-d39d-4c1d-b9a2-2277f4cd4086 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:57.430166 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-95bd9f8d-d39d-4c1d-b9a2-2277f4cd4086 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:57.567822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-95bd9f8d-d39d-4c1d-b9a2-2277f4cd4086 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:57.575384 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-95bd9f8d-d39d-4c1d-b9a2-2277f4cd4086 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.161840 Jul 15 15:54:57.575957 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 164/337] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:57 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:58.106611 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-64523211-0d57-4813-a26d-99a6c30425e6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:58.107783 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-64523211-0d57-4813-a26d-99a6c30425e6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:58.115039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-64523211-0d57-4813-a26d-99a6c30425e6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:58.115525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-64523211-0d57-4813-a26d-99a6c30425e6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:58.116318 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-64523211-0d57-4813-a26d-99a6c30425e6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:58.116868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-64523211-0d57-4813-a26d-99a6c30425e6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:58.259991 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-64523211-0d57-4813-a26d-99a6c30425e6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:58.267837 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-64523211-0d57-4813-a26d-99a6c30425e6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.166058 Jul 15 15:54:58.268543 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 174/338] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:58 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:58.594267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f7e129d7-b506-4798-a42c-120777d1e4d1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:58.594953 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f7e129d7-b506-4798-a42c-120777d1e4d1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:58.602366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7e129d7-b506-4798-a42c-120777d1e4d1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:58.602883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7e129d7-b506-4798-a42c-120777d1e4d1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:58.614408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7e129d7-b506-4798-a42c-120777d1e4d1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:58.614408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7e129d7-b506-4798-a42c-120777d1e4d1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:58.759719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f7e129d7-b506-4798-a42c-120777d1e4d1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:58.770620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f7e129d7-b506-4798-a42c-120777d1e4d1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.181548 Jul 15 15:54:58.775780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 165/339] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:58 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:59.286183 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d55ad386-0962-4d40-9be5-8dd31232a5f8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:59.286801 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d55ad386-0962-4d40-9be5-8dd31232a5f8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:59.295026 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d55ad386-0962-4d40-9be5-8dd31232a5f8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:59.295473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d55ad386-0962-4d40-9be5-8dd31232a5f8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:59.296255 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d55ad386-0962-4d40-9be5-8dd31232a5f8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:59.296696 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d55ad386-0962-4d40-9be5-8dd31232a5f8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:59.443886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d55ad386-0962-4d40-9be5-8dd31232a5f8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:59.451703 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d55ad386-0962-4d40-9be5-8dd31232a5f8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.169594 Jul 15 15:54:59.461182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 175/340] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:59 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:59.788802 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-66057469-c841-4d31-9561-3d7ab05920f6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:59.789416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-66057469-c841-4d31-9561-3d7ab05920f6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:59.796061 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-66057469-c841-4d31-9561-3d7ab05920f6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:59.796513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-66057469-c841-4d31-9561-3d7ab05920f6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:59.797292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-66057469-c841-4d31-9561-3d7ab05920f6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:59.797727 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-66057469-c841-4d31-9561-3d7ab05920f6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:59.960075 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-66057469-c841-4d31-9561-3d7ab05920f6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:59.968509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-66057469-c841-4d31-9561-3d7ab05920f6 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.183728 Jul 15 15:54:59.969077 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 166/341] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:59 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:00.468569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-daf68039-014c-4b23-bf90-5ba60b44d6e9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:00.469348 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-daf68039-014c-4b23-bf90-5ba60b44d6e9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:00.476128 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-daf68039-014c-4b23-bf90-5ba60b44d6e9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:00.476585 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-daf68039-014c-4b23-bf90-5ba60b44d6e9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:00.477443 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-daf68039-014c-4b23-bf90-5ba60b44d6e9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:00.477884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-daf68039-014c-4b23-bf90-5ba60b44d6e9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:00.617644 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-daf68039-014c-4b23-bf90-5ba60b44d6e9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:00.626253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-daf68039-014c-4b23-bf90-5ba60b44d6e9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.161493 Jul 15 15:55:00.626836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 176/342] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:00 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:00.986236 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7c4ba860-ab14-439d-9387-83ef8367445f tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:00.986909 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7c4ba860-ab14-439d-9387-83ef8367445f tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:00.993071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7c4ba860-ab14-439d-9387-83ef8367445f tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:00.993616 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7c4ba860-ab14-439d-9387-83ef8367445f tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:00.994380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7c4ba860-ab14-439d-9387-83ef8367445f tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:00.994808 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7c4ba860-ab14-439d-9387-83ef8367445f tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:01.149024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7c4ba860-ab14-439d-9387-83ef8367445f tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:01.158004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7c4ba860-ab14-439d-9387-83ef8367445f tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.176341 Jul 15 15:55:01.158590 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 167/343] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:00 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:01.643628 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8b30302e-1ad8-4413-ba8e-9ea9ba2a2e05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:01.644248 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8b30302e-1ad8-4413-ba8e-9ea9ba2a2e05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:01.650724 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8b30302e-1ad8-4413-ba8e-9ea9ba2a2e05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:01.651178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8b30302e-1ad8-4413-ba8e-9ea9ba2a2e05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:01.652105 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8b30302e-1ad8-4413-ba8e-9ea9ba2a2e05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:01.652411 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8b30302e-1ad8-4413-ba8e-9ea9ba2a2e05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:01.785649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8b30302e-1ad8-4413-ba8e-9ea9ba2a2e05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:01.794300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8b30302e-1ad8-4413-ba8e-9ea9ba2a2e05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.154596 Jul 15 15:55:01.794876 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 177/344] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:01 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:02.173919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3b868d47-f64b-4910-8292-a8d4099ea4f4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:02.174555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3b868d47-f64b-4910-8292-a8d4099ea4f4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:02.180793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3b868d47-f64b-4910-8292-a8d4099ea4f4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:02.181251 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3b868d47-f64b-4910-8292-a8d4099ea4f4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:02.182032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3b868d47-f64b-4910-8292-a8d4099ea4f4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:02.185893 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3b868d47-f64b-4910-8292-a8d4099ea4f4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:02.385457 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3b868d47-f64b-4910-8292-a8d4099ea4f4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:02.393685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3b868d47-f64b-4910-8292-a8d4099ea4f4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.223573 Jul 15 15:55:02.394258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 168/345] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:02 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:02.810896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d0a25899-6652-4983-ac11-af2e0f15a170 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:02.811553 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d0a25899-6652-4983-ac11-af2e0f15a170 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:02.818286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d0a25899-6652-4983-ac11-af2e0f15a170 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:02.818840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d0a25899-6652-4983-ac11-af2e0f15a170 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:02.819760 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d0a25899-6652-4983-ac11-af2e0f15a170 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:02.820197 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d0a25899-6652-4983-ac11-af2e0f15a170 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:02.964363 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d0a25899-6652-4983-ac11-af2e0f15a170 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:02.975415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d0a25899-6652-4983-ac11-af2e0f15a170 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.167063 Jul 15 15:55:02.976016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 178/346] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:02 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:03.410134 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1aba5d2a-4dc0-4fcf-9544-cd4341563ad7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:03.410778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1aba5d2a-4dc0-4fcf-9544-cd4341563ad7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:03.416850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1aba5d2a-4dc0-4fcf-9544-cd4341563ad7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:03.417301 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1aba5d2a-4dc0-4fcf-9544-cd4341563ad7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:03.418247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1aba5d2a-4dc0-4fcf-9544-cd4341563ad7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:03.418721 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1aba5d2a-4dc0-4fcf-9544-cd4341563ad7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:03.567024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1aba5d2a-4dc0-4fcf-9544-cd4341563ad7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:03.574726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1aba5d2a-4dc0-4fcf-9544-cd4341563ad7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.168727 Jul 15 15:55:03.575496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 169/347] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:03 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:03.991929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7054b44f-bdcd-40e6-8b91-ddb1ebe6cbd5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:03.992541 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7054b44f-bdcd-40e6-8b91-ddb1ebe6cbd5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:03.999016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7054b44f-bdcd-40e6-8b91-ddb1ebe6cbd5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:03.999508 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7054b44f-bdcd-40e6-8b91-ddb1ebe6cbd5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:04.000277 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7054b44f-bdcd-40e6-8b91-ddb1ebe6cbd5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:04.000717 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7054b44f-bdcd-40e6-8b91-ddb1ebe6cbd5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:04.156543 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7054b44f-bdcd-40e6-8b91-ddb1ebe6cbd5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:04.164394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7054b44f-bdcd-40e6-8b91-ddb1ebe6cbd5 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.176328 Jul 15 15:55:04.165004 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 179/348] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:03 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:04.592268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4f532890-812f-4855-a86d-7315c8d33853 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:04.593085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4f532890-812f-4855-a86d-7315c8d33853 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:04.599555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4f532890-812f-4855-a86d-7315c8d33853 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:04.600037 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4f532890-812f-4855-a86d-7315c8d33853 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:04.600810 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4f532890-812f-4855-a86d-7315c8d33853 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:04.601245 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4f532890-812f-4855-a86d-7315c8d33853 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:04.765254 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4f532890-812f-4855-a86d-7315c8d33853 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:04.772762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4f532890-812f-4855-a86d-7315c8d33853 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.185166 Jul 15 15:55:04.773317 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 170/349] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:04 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:05.076271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-0a57d855-2e2f-4acd-b90a-5a1f704e9e94 req-6530c0de-7b7b-46fd-a47d-9afa57598c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67042be1-b8b2-471c-a64e-3819e5ed463a", "name": "network-vif-plugged", "status": "completed", "tag": "461555b5-6e53-43f4-a1ea-2f0fff27f356"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:05.084830 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-0a57d855-2e2f-4acd-b90a-5a1f704e9e94 req-6530c0de-7b7b-46fd-a47d-9afa57598c2b service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:05.085277 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-0a57d855-2e2f-4acd-b90a-5a1f704e9e94 req-6530c0de-7b7b-46fd-a47d-9afa57598c2b service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:05.097539 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-0a57d855-2e2f-4acd-b90a-5a1f704e9e94 req-6530c0de-7b7b-46fd-a47d-9afa57598c2b service nova] Creating event network-vif-plugged:461555b5-6e53-43f4-a1ea-2f0fff27f356 for instance 67042be1-b8b2-471c-a64e-3819e5ed463a on hv-cinder-83587 Jul 15 15:55:05.103104 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-0a57d855-2e2f-4acd-b90a-5a1f704e9e94 req-6530c0de-7b7b-46fd-a47d-9afa57598c2b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031561 Jul 15 15:55:05.103731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 180/350] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:55:05.183041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4e0829a4-e110-43ce-b2d6-ad6fda612974 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:05.183678 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4e0829a4-e110-43ce-b2d6-ad6fda612974 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:05.189730 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e0829a4-e110-43ce-b2d6-ad6fda612974 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:05.190380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e0829a4-e110-43ce-b2d6-ad6fda612974 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:05.191325 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e0829a4-e110-43ce-b2d6-ad6fda612974 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:05.191916 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e0829a4-e110-43ce-b2d6-ad6fda612974 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:05.352785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4e0829a4-e110-43ce-b2d6-ad6fda612974 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:05.361291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4e0829a4-e110-43ce-b2d6-ad6fda612974 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.182655 Jul 15 15:55:05.361859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 171/351] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:05 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:05.791127 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c484d001-b2da-459c-813c-98a3399217ca tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:05.791956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c484d001-b2da-459c-813c-98a3399217ca tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:05.799158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c484d001-b2da-459c-813c-98a3399217ca tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:05.800091 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c484d001-b2da-459c-813c-98a3399217ca tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:05.801112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c484d001-b2da-459c-813c-98a3399217ca tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:05.801704 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c484d001-b2da-459c-813c-98a3399217ca tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:05.972928 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c484d001-b2da-459c-813c-98a3399217ca tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:05.980964 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c484d001-b2da-459c-813c-98a3399217ca tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.194383 Jul 15 15:55:05.981567 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 181/352] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:05 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:06.378536 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8cbcb115-01e4-4413-942f-6e2386b9e487 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:06.379315 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8cbcb115-01e4-4413-942f-6e2386b9e487 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:06.386279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cbcb115-01e4-4413-942f-6e2386b9e487 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:06.386721 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cbcb115-01e4-4413-942f-6e2386b9e487 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:06.387524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cbcb115-01e4-4413-942f-6e2386b9e487 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:06.387955 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cbcb115-01e4-4413-942f-6e2386b9e487 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:06.519963 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8cbcb115-01e4-4413-942f-6e2386b9e487 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:06.527456 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8cbcb115-01e4-4413-942f-6e2386b9e487 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.153007 Jul 15 15:55:06.528022 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 172/353] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:06 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:06.998337 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a86e3cb9-cc3e-4140-9739-602d60dd9442 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:06.998954 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a86e3cb9-cc3e-4140-9739-602d60dd9442 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:07.005437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a86e3cb9-cc3e-4140-9739-602d60dd9442 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:07.005969 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a86e3cb9-cc3e-4140-9739-602d60dd9442 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:07.006742 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a86e3cb9-cc3e-4140-9739-602d60dd9442 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:07.007177 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a86e3cb9-cc3e-4140-9739-602d60dd9442 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:07.144039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a86e3cb9-cc3e-4140-9739-602d60dd9442 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:07.151369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a86e3cb9-cc3e-4140-9739-602d60dd9442 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.156882 Jul 15 15:55:07.151934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 182/354] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:06 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:07.544037 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-63d6d1ef-2e29-43b7-828d-899b0b923572 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:07.545152 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-63d6d1ef-2e29-43b7-828d-899b0b923572 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:07.551136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-63d6d1ef-2e29-43b7-828d-899b0b923572 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:07.551622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-63d6d1ef-2e29-43b7-828d-899b0b923572 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:07.552397 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-63d6d1ef-2e29-43b7-828d-899b0b923572 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:07.555430 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-63d6d1ef-2e29-43b7-828d-899b0b923572 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:07.684528 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-63d6d1ef-2e29-43b7-828d-899b0b923572 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:07.692374 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-63d6d1ef-2e29-43b7-828d-899b0b923572 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.152178 Jul 15 15:55:07.692948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 173/355] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:07 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:08.168697 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e4dbdb58-1325-4e80-8f13-ff6117c768ad tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:08.169730 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e4dbdb58-1325-4e80-8f13-ff6117c768ad tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:08.176364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4dbdb58-1325-4e80-8f13-ff6117c768ad tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:08.176819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4dbdb58-1325-4e80-8f13-ff6117c768ad tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:08.177597 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4dbdb58-1325-4e80-8f13-ff6117c768ad tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:08.178027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4dbdb58-1325-4e80-8f13-ff6117c768ad tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:08.304137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e4dbdb58-1325-4e80-8f13-ff6117c768ad tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:08.312126 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e4dbdb58-1325-4e80-8f13-ff6117c768ad tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.147348 Jul 15 15:55:08.312693 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 183/356] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:08 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:08.708936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-848ebdc7-c599-4530-9581-bacae9d06b5d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:08.709544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-848ebdc7-c599-4530-9581-bacae9d06b5d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:08.715775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-848ebdc7-c599-4530-9581-bacae9d06b5d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:08.716775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-848ebdc7-c599-4530-9581-bacae9d06b5d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:08.717539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-848ebdc7-c599-4530-9581-bacae9d06b5d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:08.717975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-848ebdc7-c599-4530-9581-bacae9d06b5d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:08.721988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:08.843224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-848ebdc7-c599-4530-9581-bacae9d06b5d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:08.851235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-848ebdc7-c599-4530-9581-bacae9d06b5d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.146024 Jul 15 15:55:08.851828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 174/357] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:08 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:09.329023 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4b14b9d5-97f1-46e3-8f98-39863b7b7da5 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:09.329649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4b14b9d5-97f1-46e3-8f98-39863b7b7da5 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:09.336472 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b14b9d5-97f1-46e3-8f98-39863b7b7da5 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:09.336931 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b14b9d5-97f1-46e3-8f98-39863b7b7da5 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:09.337706 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b14b9d5-97f1-46e3-8f98-39863b7b7da5 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:09.338149 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b14b9d5-97f1-46e3-8f98-39863b7b7da5 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:09.470623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4b14b9d5-97f1-46e3-8f98-39863b7b7da5 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:09.479093 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4b14b9d5-97f1-46e3-8f98-39863b7b7da5 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.154560 Jul 15 15:55:09.479694 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 184/358] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:09 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:09.867419 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1aca979b-0636-420c-b4ec-4836f893fe83 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:09.868042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1aca979b-0636-420c-b4ec-4836f893fe83 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:09.874875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1aca979b-0636-420c-b4ec-4836f893fe83 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:09.875454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1aca979b-0636-420c-b4ec-4836f893fe83 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:09.876167 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1aca979b-0636-420c-b4ec-4836f893fe83 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:09.876608 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1aca979b-0636-420c-b4ec-4836f893fe83 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:10.007344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1aca979b-0636-420c-b4ec-4836f893fe83 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:10.014728 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1aca979b-0636-420c-b4ec-4836f893fe83 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.151204 Jul 15 15:55:10.015280 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 175/359] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:09 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:10.495804 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bd32254d-7b45-4fbb-b84d-708eba41645d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:10.496415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bd32254d-7b45-4fbb-b84d-708eba41645d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:10.503603 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd32254d-7b45-4fbb-b84d-708eba41645d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:10.504055 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd32254d-7b45-4fbb-b84d-708eba41645d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:10.504812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd32254d-7b45-4fbb-b84d-708eba41645d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:10.505244 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd32254d-7b45-4fbb-b84d-708eba41645d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:10.633438 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bd32254d-7b45-4fbb-b84d-708eba41645d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:10.640739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bd32254d-7b45-4fbb-b84d-708eba41645d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.148816 Jul 15 15:55:10.641298 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 185/360] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:10 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:11.031956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ef00b58f-7c3d-4224-9b2f-a1fdff4ed295 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:11.032500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ef00b58f-7c3d-4224-9b2f-a1fdff4ed295 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:11.038546 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef00b58f-7c3d-4224-9b2f-a1fdff4ed295 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:11.039001 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef00b58f-7c3d-4224-9b2f-a1fdff4ed295 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:11.039804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef00b58f-7c3d-4224-9b2f-a1fdff4ed295 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:11.040248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef00b58f-7c3d-4224-9b2f-a1fdff4ed295 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:11.171466 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ef00b58f-7c3d-4224-9b2f-a1fdff4ed295 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:11.176788 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ef00b58f-7c3d-4224-9b2f-a1fdff4ed295 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.149280 Jul 15 15:55:11.177362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 176/361] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:11 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:11.656421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-804b1439-03a7-41d5-a885-120fef4d1fc1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:11.657039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-804b1439-03a7-41d5-a885-120fef4d1fc1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:11.659591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=69 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:11.664370 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-804b1439-03a7-41d5-a885-120fef4d1fc1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:11.664821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-804b1439-03a7-41d5-a885-120fef4d1fc1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:11.670335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-804b1439-03a7-41d5-a885-120fef4d1fc1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:11.670335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-804b1439-03a7-41d5-a885-120fef4d1fc1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:11.796732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-804b1439-03a7-41d5-a885-120fef4d1fc1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:11.804127 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-804b1439-03a7-41d5-a885-120fef4d1fc1 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.151503 Jul 15 15:55:11.804688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 186/362] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:11 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:12.193424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-48e18f0e-996a-4284-9e44-205806dff03e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:12.194060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-48e18f0e-996a-4284-9e44-205806dff03e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:12.200337 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-48e18f0e-996a-4284-9e44-205806dff03e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:12.200789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-48e18f0e-996a-4284-9e44-205806dff03e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:12.201555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-48e18f0e-996a-4284-9e44-205806dff03e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:12.202087 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-48e18f0e-996a-4284-9e44-205806dff03e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:12.332546 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-48e18f0e-996a-4284-9e44-205806dff03e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:12.340159 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-48e18f0e-996a-4284-9e44-205806dff03e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.150308 Jul 15 15:55:12.340719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 177/363] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:12 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:12.821309 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bd2f9bea-093f-49fa-8238-a46c319a3445 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:12.821918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bd2f9bea-093f-49fa-8238-a46c319a3445 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:12.828537 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd2f9bea-093f-49fa-8238-a46c319a3445 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:12.828980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd2f9bea-093f-49fa-8238-a46c319a3445 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:12.829741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd2f9bea-093f-49fa-8238-a46c319a3445 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:12.830187 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd2f9bea-093f-49fa-8238-a46c319a3445 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:12.960896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bd2f9bea-093f-49fa-8238-a46c319a3445 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:12.970311 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bd2f9bea-093f-49fa-8238-a46c319a3445 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.152750 Jul 15 15:55:12.971137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 187/364] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:12 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:13.177504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-767ec572-a9fe-4dba-a93d-9ad7e85ea8ff tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:13.178003 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-767ec572-a9fe-4dba-a93d-9ad7e85ea8ff tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:13.184025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-767ec572-a9fe-4dba-a93d-9ad7e85ea8ff tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:13.184508 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-767ec572-a9fe-4dba-a93d-9ad7e85ea8ff tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:13.185252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-767ec572-a9fe-4dba-a93d-9ad7e85ea8ff tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:13.185686 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-767ec572-a9fe-4dba-a93d-9ad7e85ea8ff tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:13.210119 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-767ec572-a9fe-4dba-a93d-9ad7e85ea8ff tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:55:13.357466 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9133fc95-e1bd-4af9-aa9b-b52b6ece59af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:13.358213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9133fc95-e1bd-4af9-aa9b-b52b6ece59af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:13.364534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9133fc95-e1bd-4af9-aa9b-b52b6ece59af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:13.364992 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9133fc95-e1bd-4af9-aa9b-b52b6ece59af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:13.365962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9133fc95-e1bd-4af9-aa9b-b52b6ece59af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:13.366590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9133fc95-e1bd-4af9-aa9b-b52b6ece59af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:13.507434 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9133fc95-e1bd-4af9-aa9b-b52b6ece59af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:13.508478 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-767ec572-a9fe-4dba-a93d-9ad7e85ea8ff tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 204 len: 0 microversion: 2.1 time: 0.334368 Jul 15 15:55:13.510726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 178/365] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 15:55:13 2022] DELETE /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:55:13.516382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9133fc95-e1bd-4af9-aa9b-b52b6ece59af tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.162619 Jul 15 15:55:13.517490 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 188/366] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:13 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:13.520506 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-09de2162-e695-435a-8eca-13999b0926dc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:13.521384 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-09de2162-e695-435a-8eca-13999b0926dc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:13.529412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-09de2162-e695-435a-8eca-13999b0926dc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:13.529866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-09de2162-e695-435a-8eca-13999b0926dc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:13.530704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-09de2162-e695-435a-8eca-13999b0926dc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:13.531079 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-09de2162-e695-435a-8eca-13999b0926dc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:13.669475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-09de2162-e695-435a-8eca-13999b0926dc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:13.677336 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-09de2162-e695-435a-8eca-13999b0926dc tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.161294 Jul 15 15:55:13.677890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 179/367] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:13 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:13.987960 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5c8d05e5-4a78-44f9-a822-49d623908146 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:13.988584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5c8d05e5-4a78-44f9-a822-49d623908146 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:13.994999 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c8d05e5-4a78-44f9-a822-49d623908146 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:13.995503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c8d05e5-4a78-44f9-a822-49d623908146 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:13.996283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c8d05e5-4a78-44f9-a822-49d623908146 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:13.996851 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5c8d05e5-4a78-44f9-a822-49d623908146 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:14.128582 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5c8d05e5-4a78-44f9-a822-49d623908146 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:14.136222 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5c8d05e5-4a78-44f9-a822-49d623908146 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1311 microversion: 2.1 time: 0.152052 Jul 15 15:55:14.136824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 189/368] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:13 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:14.535213 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-806f8c1b-d363-4959-9785-89ab474c7f0b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:14.535855 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-806f8c1b-d363-4959-9785-89ab474c7f0b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:14.537882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:14.546656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-806f8c1b-d363-4959-9785-89ab474c7f0b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:14.548405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-806f8c1b-d363-4959-9785-89ab474c7f0b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:14.548405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-806f8c1b-d363-4959-9785-89ab474c7f0b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:14.548628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-806f8c1b-d363-4959-9785-89ab474c7f0b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:14.680148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-806f8c1b-d363-4959-9785-89ab474c7f0b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:14.687914 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-806f8c1b-d363-4959-9785-89ab474c7f0b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.157203 Jul 15 15:55:14.689432 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 180/369] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:14 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:14.694584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-476b8300-02f5-42a5-8bf4-f57e8b93f102 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:14.695285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-476b8300-02f5-42a5-8bf4-f57e8b93f102 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:14.702206 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-476b8300-02f5-42a5-8bf4-f57e8b93f102 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:14.707699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-476b8300-02f5-42a5-8bf4-f57e8b93f102 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:14.707699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-476b8300-02f5-42a5-8bf4-f57e8b93f102 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:14.707699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-476b8300-02f5-42a5-8bf4-f57e8b93f102 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:14.831248 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-476b8300-02f5-42a5-8bf4-f57e8b93f102 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:14.839145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-476b8300-02f5-42a5-8bf4-f57e8b93f102 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.148434 Jul 15 15:55:14.840070 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 190/370] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:14 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:15.152789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b969a5d3-a6f2-4f77-9c2a-cc486c76e333 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:15.153913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b969a5d3-a6f2-4f77-9c2a-cc486c76e333 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:15.160351 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b969a5d3-a6f2-4f77-9c2a-cc486c76e333 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:15.160803 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b969a5d3-a6f2-4f77-9c2a-cc486c76e333 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:15.161574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b969a5d3-a6f2-4f77-9c2a-cc486c76e333 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:15.162012 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b969a5d3-a6f2-4f77-9c2a-cc486c76e333 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:15.294407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b969a5d3-a6f2-4f77-9c2a-cc486c76e333 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:15.301984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b969a5d3-a6f2-4f77-9c2a-cc486c76e333 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1495 microversion: 2.1 time: 0.153070 Jul 15 15:55:15.302553 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 181/371] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:15 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:15.704761 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1d3adf54-d24e-408c-b267-762570ed23cc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:15.705410 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1d3adf54-d24e-408c-b267-762570ed23cc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:15.711964 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d3adf54-d24e-408c-b267-762570ed23cc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:15.712421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d3adf54-d24e-408c-b267-762570ed23cc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:15.713191 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d3adf54-d24e-408c-b267-762570ed23cc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:15.713632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d3adf54-d24e-408c-b267-762570ed23cc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:15.718490 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:15.842511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1d3adf54-d24e-408c-b267-762570ed23cc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:15.849839 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1d3adf54-d24e-408c-b267-762570ed23cc tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.148955 Jul 15 15:55:15.850398 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 191/372] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:15 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:15.855706 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a3197764-2fb7-44a2-9d85-9e767594b289 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:15.856317 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a3197764-2fb7-44a2-9d85-9e767594b289 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:15.862304 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a3197764-2fb7-44a2-9d85-9e767594b289 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:15.862782 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a3197764-2fb7-44a2-9d85-9e767594b289 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:15.863577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a3197764-2fb7-44a2-9d85-9e767594b289 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:15.864016 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a3197764-2fb7-44a2-9d85-9e767594b289 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:15.991166 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a3197764-2fb7-44a2-9d85-9e767594b289 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:15.999585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a3197764-2fb7-44a2-9d85-9e767594b289 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.147725 Jul 15 15:55:16.000142 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 182/373] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:15 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:16.866112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-beeb584c-ee92-4b72-a2eb-e5101363e76f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:16.868058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-beeb584c-ee92-4b72-a2eb-e5101363e76f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:16.874932 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-beeb584c-ee92-4b72-a2eb-e5101363e76f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:16.875561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-beeb584c-ee92-4b72-a2eb-e5101363e76f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:16.876372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-beeb584c-ee92-4b72-a2eb-e5101363e76f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:16.876800 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-beeb584c-ee92-4b72-a2eb-e5101363e76f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:17.008300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-beeb584c-ee92-4b72-a2eb-e5101363e76f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:17.022451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f16bdb2e-8d69-4da4-a556-f0d4a57f4c7c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:17.022962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-beeb584c-ee92-4b72-a2eb-e5101363e76f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.156024 Jul 15 15:55:17.023068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f16bdb2e-8d69-4da4-a556-f0d4a57f4c7c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:17.023167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 192/374] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:16 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:17.024958 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f16bdb2e-8d69-4da4-a556-f0d4a57f4c7c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:17.025440 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f16bdb2e-8d69-4da4-a556-f0d4a57f4c7c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:17.026234 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f16bdb2e-8d69-4da4-a556-f0d4a57f4c7c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:17.026666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f16bdb2e-8d69-4da4-a556-f0d4a57f4c7c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:17.173977 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f16bdb2e-8d69-4da4-a556-f0d4a57f4c7c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:17.183361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f16bdb2e-8d69-4da4-a556-f0d4a57f4c7c tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.169941 Jul 15 15:55:17.183930 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 183/375] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:17 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:18.037938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-88503fdb-496b-449c-b77e-73b1d20bc535 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:18.038548 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-88503fdb-496b-449c-b77e-73b1d20bc535 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:18.045677 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-88503fdb-496b-449c-b77e-73b1d20bc535 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:18.046131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-88503fdb-496b-449c-b77e-73b1d20bc535 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:18.046913 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-88503fdb-496b-449c-b77e-73b1d20bc535 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:18.047384 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-88503fdb-496b-449c-b77e-73b1d20bc535 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:18.178637 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-88503fdb-496b-449c-b77e-73b1d20bc535 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:18.186119 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-88503fdb-496b-449c-b77e-73b1d20bc535 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.152034 Jul 15 15:55:18.186689 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 193/376] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:18 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:18.200881 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e9779ed9-86f3-43d9-8ea9-a96e005b3238 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:18.201514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e9779ed9-86f3-43d9-8ea9-a96e005b3238 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:18.208361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e9779ed9-86f3-43d9-8ea9-a96e005b3238 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:18.209149 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e9779ed9-86f3-43d9-8ea9-a96e005b3238 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:18.210521 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e9779ed9-86f3-43d9-8ea9-a96e005b3238 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:18.211317 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e9779ed9-86f3-43d9-8ea9-a96e005b3238 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:18.344039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e9779ed9-86f3-43d9-8ea9-a96e005b3238 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:18.352101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e9779ed9-86f3-43d9-8ea9-a96e005b3238 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.155041 Jul 15 15:55:18.352704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 184/377] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:18 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:19.202013 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5fbee537-4790-4d57-9d82-4965b257cb59 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:19.202729 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5fbee537-4790-4d57-9d82-4965b257cb59 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:19.209250 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5fbee537-4790-4d57-9d82-4965b257cb59 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:19.209702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5fbee537-4790-4d57-9d82-4965b257cb59 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:19.210474 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5fbee537-4790-4d57-9d82-4965b257cb59 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:19.210912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5fbee537-4790-4d57-9d82-4965b257cb59 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:19.341603 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5fbee537-4790-4d57-9d82-4965b257cb59 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:19.349115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5fbee537-4790-4d57-9d82-4965b257cb59 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.150918 Jul 15 15:55:19.349684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 194/378] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:19 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:19.369064 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bde6c66b-fdb3-47a7-9caa-39d85469ccec tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:19.369676 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-bde6c66b-fdb3-47a7-9caa-39d85469ccec tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:19.376277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bde6c66b-fdb3-47a7-9caa-39d85469ccec tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:19.376731 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bde6c66b-fdb3-47a7-9caa-39d85469ccec tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:19.377501 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bde6c66b-fdb3-47a7-9caa-39d85469ccec tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:19.377936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bde6c66b-fdb3-47a7-9caa-39d85469ccec tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:19.509015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-bde6c66b-fdb3-47a7-9caa-39d85469ccec tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:19.517325 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-bde6c66b-fdb3-47a7-9caa-39d85469ccec tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.151990 Jul 15 15:55:19.517882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 185/379] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:19 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:20.366549 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6c7578a3-b790-41a9-a354-9638433d2886 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:20.367162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6c7578a3-b790-41a9-a354-9638433d2886 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:20.374324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c7578a3-b790-41a9-a354-9638433d2886 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:20.374768 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c7578a3-b790-41a9-a354-9638433d2886 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:20.375569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c7578a3-b790-41a9-a354-9638433d2886 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:20.376016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c7578a3-b790-41a9-a354-9638433d2886 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:20.502544 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6c7578a3-b790-41a9-a354-9638433d2886 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:20.510159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6c7578a3-b790-41a9-a354-9638433d2886 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.147492 Jul 15 15:55:20.510726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 195/380] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:20 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:20.533750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ed454675-6c8f-42d8-bc38-fce4f9250b1d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:20.534360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ed454675-6c8f-42d8-bc38-fce4f9250b1d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:20.540568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ed454675-6c8f-42d8-bc38-fce4f9250b1d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:20.541475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ed454675-6c8f-42d8-bc38-fce4f9250b1d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:20.542247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ed454675-6c8f-42d8-bc38-fce4f9250b1d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:20.542682 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ed454675-6c8f-42d8-bc38-fce4f9250b1d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:20.630382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3b6ba46d-141f-4839-baf8-5c2c6de2a0fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:20.630968 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3b6ba46d-141f-4839-baf8-5c2c6de2a0fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:20.637944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3b6ba46d-141f-4839-baf8-5c2c6de2a0fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:20.638524 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3b6ba46d-141f-4839-baf8-5c2c6de2a0fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:20.639542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3b6ba46d-141f-4839-baf8-5c2c6de2a0fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:20.640057 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3b6ba46d-141f-4839-baf8-5c2c6de2a0fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:20.665375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3b6ba46d-141f-4839-baf8-5c2c6de2a0fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:55:20.674100 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ed454675-6c8f-42d8-bc38-fce4f9250b1d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:20.682204 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ed454675-6c8f-42d8-bc38-fce4f9250b1d tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.152227 Jul 15 15:55:20.682775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 186/381] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:20 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:21.035877 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3b6ba46d-141f-4839-baf8-5c2c6de2a0fd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "DELETE /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 204 len: 0 microversion: 2.1 time: 0.409051 Jul 15 15:55:21.036567 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 196/382] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 15:55:20 2022] DELETE /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 15:55:21.044677 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9f7d838c-7603-47e0-9a75-6219fd51adfc tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:21.045291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9f7d838c-7603-47e0-9a75-6219fd51adfc tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:21.051439 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9f7d838c-7603-47e0-9a75-6219fd51adfc tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:21.051889 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9f7d838c-7603-47e0-9a75-6219fd51adfc tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:21.052654 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9f7d838c-7603-47e0-9a75-6219fd51adfc tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:21.053093 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9f7d838c-7603-47e0-9a75-6219fd51adfc tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:21.185588 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9f7d838c-7603-47e0-9a75-6219fd51adfc tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:21.193633 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9f7d838c-7603-47e0-9a75-6219fd51adfc tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1501 microversion: 2.1 time: 0.152730 Jul 15 15:55:21.194298 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 187/383] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:21 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:21.527871 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0b87652d-b427-4e88-a155-d7b100d26dc9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:21.528568 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0b87652d-b427-4e88-a155-d7b100d26dc9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:21.535020 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0b87652d-b427-4e88-a155-d7b100d26dc9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:21.535511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0b87652d-b427-4e88-a155-d7b100d26dc9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:21.536274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0b87652d-b427-4e88-a155-d7b100d26dc9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:21.536711 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0b87652d-b427-4e88-a155-d7b100d26dc9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:21.671518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0b87652d-b427-4e88-a155-d7b100d26dc9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:21.676077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0b87652d-b427-4e88-a155-d7b100d26dc9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.152340 Jul 15 15:55:21.676650 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 197/384] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:21 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:21.699745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3640ec6e-1658-4381-aaa0-a4ecf43121ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:21.700353 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3640ec6e-1658-4381-aaa0-a4ecf43121ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:21.706249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3640ec6e-1658-4381-aaa0-a4ecf43121ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:21.706693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3640ec6e-1658-4381-aaa0-a4ecf43121ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:21.707537 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3640ec6e-1658-4381-aaa0-a4ecf43121ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:21.707973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3640ec6e-1658-4381-aaa0-a4ecf43121ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:21.834734 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3640ec6e-1658-4381-aaa0-a4ecf43121ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:21.842869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3640ec6e-1658-4381-aaa0-a4ecf43121ef tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.147009 Jul 15 15:55:21.843460 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 188/385] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:21 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:22.211394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a7a50f9d-77d0-4ff9-97bc-994c958cda4e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:22.212045 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a7a50f9d-77d0-4ff9-97bc-994c958cda4e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:22.218863 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7a50f9d-77d0-4ff9-97bc-994c958cda4e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:22.219337 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7a50f9d-77d0-4ff9-97bc-994c958cda4e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:22.220101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7a50f9d-77d0-4ff9-97bc-994c958cda4e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:22.220533 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7a50f9d-77d0-4ff9-97bc-994c958cda4e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:22.348428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a7a50f9d-77d0-4ff9-97bc-994c958cda4e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:22.355885 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a7a50f9d-77d0-4ff9-97bc-994c958cda4e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1501 microversion: 2.1 time: 0.148456 Jul 15 15:55:22.356459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 198/386] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:22 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:22.693181 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-672972e1-4a7c-41db-98f7-e3d367374685 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:22.693780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-672972e1-4a7c-41db-98f7-e3d367374685 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:22.700317 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-672972e1-4a7c-41db-98f7-e3d367374685 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:22.700921 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-672972e1-4a7c-41db-98f7-e3d367374685 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:22.701494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-672972e1-4a7c-41db-98f7-e3d367374685 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:22.701919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-672972e1-4a7c-41db-98f7-e3d367374685 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:22.705774 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:22.825504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-672972e1-4a7c-41db-98f7-e3d367374685 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:22.832786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-672972e1-4a7c-41db-98f7-e3d367374685 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.143304 Jul 15 15:55:22.833538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 189/387] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:22 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:22.859732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-09c76fe6-d92c-4601-9d2e-5b452cedf8db tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:22.860354 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-09c76fe6-d92c-4601-9d2e-5b452cedf8db tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:22.866845 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-09c76fe6-d92c-4601-9d2e-5b452cedf8db tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:22.867314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-09c76fe6-d92c-4601-9d2e-5b452cedf8db tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:22.868089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-09c76fe6-d92c-4601-9d2e-5b452cedf8db tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:22.868585 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-09c76fe6-d92c-4601-9d2e-5b452cedf8db tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:23.002656 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-09c76fe6-d92c-4601-9d2e-5b452cedf8db tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:23.010903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-09c76fe6-d92c-4601-9d2e-5b452cedf8db tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.155069 Jul 15 15:55:23.011501 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 199/388] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:22 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:23.373562 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e66cd717-2c39-4b43-b1ae-26654e7ff767 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:23.374206 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e66cd717-2c39-4b43-b1ae-26654e7ff767 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:23.380272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e66cd717-2c39-4b43-b1ae-26654e7ff767 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:23.380721 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e66cd717-2c39-4b43-b1ae-26654e7ff767 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:23.381489 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e66cd717-2c39-4b43-b1ae-26654e7ff767 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:23.381923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e66cd717-2c39-4b43-b1ae-26654e7ff767 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:23.509587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e66cd717-2c39-4b43-b1ae-26654e7ff767 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:23.516991 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e66cd717-2c39-4b43-b1ae-26654e7ff767 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1501 microversion: 2.1 time: 0.147925 Jul 15 15:55:23.517551 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 190/389] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:23 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:23.849760 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-00d781f5-8bba-4fc7-b133-faaceccf2088 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:23.850366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-00d781f5-8bba-4fc7-b133-faaceccf2088 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:23.857283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00d781f5-8bba-4fc7-b133-faaceccf2088 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:23.857760 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00d781f5-8bba-4fc7-b133-faaceccf2088 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:23.858518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00d781f5-8bba-4fc7-b133-faaceccf2088 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:23.858952 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00d781f5-8bba-4fc7-b133-faaceccf2088 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:23.988259 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-00d781f5-8bba-4fc7-b133-faaceccf2088 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:23.996047 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-00d781f5-8bba-4fc7-b133-faaceccf2088 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.150113 Jul 15 15:55:23.996613 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 200/390] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:23 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:24.028200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5b19ff33-8e83-4750-aa2e-74d37ce3f127 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:24.028815 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5b19ff33-8e83-4750-aa2e-74d37ce3f127 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:24.034819 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b19ff33-8e83-4750-aa2e-74d37ce3f127 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:24.035271 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b19ff33-8e83-4750-aa2e-74d37ce3f127 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:24.036083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b19ff33-8e83-4750-aa2e-74d37ce3f127 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:24.036524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b19ff33-8e83-4750-aa2e-74d37ce3f127 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:24.164621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5b19ff33-8e83-4750-aa2e-74d37ce3f127 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:24.173162 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5b19ff33-8e83-4750-aa2e-74d37ce3f127 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.148827 Jul 15 15:55:24.173726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 191/391] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:24 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:24.534840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a8096c4e-5a61-48bc-bd24-a99259b6ed94 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:24.535493 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a8096c4e-5a61-48bc-bd24-a99259b6ed94 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:24.541569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a8096c4e-5a61-48bc-bd24-a99259b6ed94 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:24.542030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a8096c4e-5a61-48bc-bd24-a99259b6ed94 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:24.542801 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a8096c4e-5a61-48bc-bd24-a99259b6ed94 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:24.543239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a8096c4e-5a61-48bc-bd24-a99259b6ed94 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:24.677466 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a8096c4e-5a61-48bc-bd24-a99259b6ed94 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:24.685576 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a8096c4e-5a61-48bc-bd24-a99259b6ed94 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1501 microversion: 2.1 time: 0.155446 Jul 15 15:55:24.686455 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 201/392] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:24 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:25.013476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5ab77637-068d-4bb3-b38e-9ddddee6363e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:25.014097 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5ab77637-068d-4bb3-b38e-9ddddee6363e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:25.020238 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5ab77637-068d-4bb3-b38e-9ddddee6363e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:25.023554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5ab77637-068d-4bb3-b38e-9ddddee6363e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:25.023554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5ab77637-068d-4bb3-b38e-9ddddee6363e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:25.023554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5ab77637-068d-4bb3-b38e-9ddddee6363e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:25.153774 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5ab77637-068d-4bb3-b38e-9ddddee6363e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:25.161183 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5ab77637-068d-4bb3-b38e-9ddddee6363e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.151711 Jul 15 15:55:25.161746 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 192/393] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:25 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:25.189675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ff1c3d4b-4850-4722-94f6-f7bbc16f6276 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:25.190295 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ff1c3d4b-4850-4722-94f6-f7bbc16f6276 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:25.196738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ff1c3d4b-4850-4722-94f6-f7bbc16f6276 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:25.197186 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ff1c3d4b-4850-4722-94f6-f7bbc16f6276 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:25.197947 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ff1c3d4b-4850-4722-94f6-f7bbc16f6276 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:25.198385 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ff1c3d4b-4850-4722-94f6-f7bbc16f6276 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:25.330016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ff1c3d4b-4850-4722-94f6-f7bbc16f6276 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:25.338007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ff1c3d4b-4850-4722-94f6-f7bbc16f6276 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.152091 Jul 15 15:55:25.338584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 202/394] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:25 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:25.703199 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1997f2bd-a36f-4615-91da-269e20924f49 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:25.703751 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1997f2bd-a36f-4615-91da-269e20924f49 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:25.711838 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1997f2bd-a36f-4615-91da-269e20924f49 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:25.712298 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1997f2bd-a36f-4615-91da-269e20924f49 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:25.713088 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1997f2bd-a36f-4615-91da-269e20924f49 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:25.714310 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1997f2bd-a36f-4615-91da-269e20924f49 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:25.843485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1997f2bd-a36f-4615-91da-269e20924f49 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:25.850918 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1997f2bd-a36f-4615-91da-269e20924f49 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1501 microversion: 2.1 time: 0.152276 Jul 15 15:55:25.859808 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 193/395] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:25 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:26.178105 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a11c70b2-fdad-4e6c-be90-77ff7c00cede tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:26.178760 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a11c70b2-fdad-4e6c-be90-77ff7c00cede tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:26.185723 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a11c70b2-fdad-4e6c-be90-77ff7c00cede tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:26.186173 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a11c70b2-fdad-4e6c-be90-77ff7c00cede tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:26.186976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a11c70b2-fdad-4e6c-be90-77ff7c00cede tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:26.187442 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a11c70b2-fdad-4e6c-be90-77ff7c00cede tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:26.319251 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a11c70b2-fdad-4e6c-be90-77ff7c00cede tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:26.326980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a11c70b2-fdad-4e6c-be90-77ff7c00cede tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.152861 Jul 15 15:55:26.327628 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 203/396] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:26 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:26.356017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5442a5e2-04dd-4257-91a3-4f0470c62ec8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:26.357101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5442a5e2-04dd-4257-91a3-4f0470c62ec8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:26.363191 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5442a5e2-04dd-4257-91a3-4f0470c62ec8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:26.363671 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5442a5e2-04dd-4257-91a3-4f0470c62ec8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:26.364436 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5442a5e2-04dd-4257-91a3-4f0470c62ec8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:26.364867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5442a5e2-04dd-4257-91a3-4f0470c62ec8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:26.625019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5442a5e2-04dd-4257-91a3-4f0470c62ec8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:26.632855 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5442a5e2-04dd-4257-91a3-4f0470c62ec8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.280686 Jul 15 15:55:26.633418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 194/397] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:26 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:26.868561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-29bd7308-3fc8-45aa-8643-38204fd23845 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:26.879987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-29bd7308-3fc8-45aa-8643-38204fd23845 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:26.879987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-29bd7308-3fc8-45aa-8643-38204fd23845 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:26.879987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-29bd7308-3fc8-45aa-8643-38204fd23845 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:26.879987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-29bd7308-3fc8-45aa-8643-38204fd23845 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:26.880695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-29bd7308-3fc8-45aa-8643-38204fd23845 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:27.204807 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-29bd7308-3fc8-45aa-8643-38204fd23845 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:27.213105 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-29bd7308-3fc8-45aa-8643-38204fd23845 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1501 microversion: 2.1 time: 0.348908 Jul 15 15:55:27.213691 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 204/398] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:26 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1501 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:27.344935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9a08fe5a-7d68-4058-8dc7-c0d9c7ff6cad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:27.345766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9a08fe5a-7d68-4058-8dc7-c0d9c7ff6cad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:27.354494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9a08fe5a-7d68-4058-8dc7-c0d9c7ff6cad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:27.355174 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9a08fe5a-7d68-4058-8dc7-c0d9c7ff6cad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:27.356140 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9a08fe5a-7d68-4058-8dc7-c0d9c7ff6cad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:27.356725 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9a08fe5a-7d68-4058-8dc7-c0d9c7ff6cad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:27.523471 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9a08fe5a-7d68-4058-8dc7-c0d9c7ff6cad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:27.532334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9a08fe5a-7d68-4058-8dc7-c0d9c7ff6cad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.191736 Jul 15 15:55:27.535913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 195/399] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:27 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:27.650114 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-31265b31-497c-44ac-acc8-a514812eb86a tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:27.650729 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-31265b31-497c-44ac-acc8-a514812eb86a tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:27.664445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-31265b31-497c-44ac-acc8-a514812eb86a tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:27.664756 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-31265b31-497c-44ac-acc8-a514812eb86a tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:27.665707 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-31265b31-497c-44ac-acc8-a514812eb86a tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:27.666561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-31265b31-497c-44ac-acc8-a514812eb86a tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:27.916616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-31265b31-497c-44ac-acc8-a514812eb86a tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:27.928563 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-31265b31-497c-44ac-acc8-a514812eb86a tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1555 microversion: 2.1 time: 0.281710 Jul 15 15:55:27.939701 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 205/400] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:27 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:28.224967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-111ab4c1-6d34-4cff-903e-ed49d9f46dab req-7b12cc21-4dfe-4540-817c-eb4f2665ee5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67042be1-b8b2-471c-a64e-3819e5ed463a", "name": "network-vif-deleted", "tag": "461555b5-6e53-43f4-a1ea-2f0fff27f356"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:28.234867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-111ab4c1-6d34-4cff-903e-ed49d9f46dab req-7b12cc21-4dfe-4540-817c-eb4f2665ee5c service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:28.235626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d181a510-e457-4313-997a-44cd0f69872b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:28.235817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-111ab4c1-6d34-4cff-903e-ed49d9f46dab req-7b12cc21-4dfe-4540-817c-eb4f2665ee5c service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:28.236926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d181a510-e457-4313-997a-44cd0f69872b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:28.247170 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d181a510-e457-4313-997a-44cd0f69872b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:28.247962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d181a510-e457-4313-997a-44cd0f69872b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:28.249259 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-111ab4c1-6d34-4cff-903e-ed49d9f46dab req-7b12cc21-4dfe-4540-817c-eb4f2665ee5c service nova] Creating event network-vif-deleted:461555b5-6e53-43f4-a1ea-2f0fff27f356 for instance 67042be1-b8b2-471c-a64e-3819e5ed463a on hv-cinder-83587 Jul 15 15:55:28.249966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d181a510-e457-4313-997a-44cd0f69872b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:28.250604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d181a510-e457-4313-997a-44cd0f69872b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:28.255600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-111ab4c1-6d34-4cff-903e-ed49d9f46dab req-7b12cc21-4dfe-4540-817c-eb4f2665ee5c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034658 Jul 15 15:55:28.256814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 196/401] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:55:28.257800 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:28.325632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d181a510-e457-4313-997a-44cd0f69872b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:28.333106 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d181a510-e457-4313-997a-44cd0f69872b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1459 microversion: 2.1 time: 0.106696 Jul 15 15:55:28.333683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 206/402] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:28 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1459 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:28.490678 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-a3991da2-2bf6-4b03-9315-058eebdb6a23 req-c7591d99-9227-45b5-ab4e-af98f7ab4bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3687d5cd-925a-43c4-a87e-a36664f4a2c1", "name": "network-vif-deleted", "tag": "d3d2d474-04a0-4618-89b1-cf1ca09b1df1"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:28.499957 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-a3991da2-2bf6-4b03-9315-058eebdb6a23 req-c7591d99-9227-45b5-ab4e-af98f7ab4bd6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:28.500628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-a3991da2-2bf6-4b03-9315-058eebdb6a23 req-c7591d99-9227-45b5-ab4e-af98f7ab4bd6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:28.512844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-a3991da2-2bf6-4b03-9315-058eebdb6a23 req-c7591d99-9227-45b5-ab4e-af98f7ab4bd6 service nova] Creating event network-vif-deleted:d3d2d474-04a0-4618-89b1-cf1ca09b1df1 for instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 on hv-cinder-83587 Jul 15 15:55:28.518755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-a3991da2-2bf6-4b03-9315-058eebdb6a23 req-c7591d99-9227-45b5-ab4e-af98f7ab4bd6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Jul 15 15:55:28.519381 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 197/403] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:55:28.553449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-38eb1110-d67e-4d62-a0c6-abafaac5d6ba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:28.554184 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-38eb1110-d67e-4d62-a0c6-abafaac5d6ba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:28.561755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38eb1110-d67e-4d62-a0c6-abafaac5d6ba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:28.568442 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38eb1110-d67e-4d62-a0c6-abafaac5d6ba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:28.569318 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38eb1110-d67e-4d62-a0c6-abafaac5d6ba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:28.569749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38eb1110-d67e-4d62-a0c6-abafaac5d6ba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:28.701852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-38eb1110-d67e-4d62-a0c6-abafaac5d6ba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:28.708876 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-38eb1110-d67e-4d62-a0c6-abafaac5d6ba tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.160041 Jul 15 15:55:28.709445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 207/404] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:28 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:28.946610 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f2760400-f656-49b9-bc7c-a770012b6798 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:28.947323 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f2760400-f656-49b9-bc7c-a770012b6798 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:28.953544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2760400-f656-49b9-bc7c-a770012b6798 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:28.953999 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2760400-f656-49b9-bc7c-a770012b6798 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:28.954766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2760400-f656-49b9-bc7c-a770012b6798 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:28.955249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2760400-f656-49b9-bc7c-a770012b6798 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:29.018542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f2760400-f656-49b9-bc7c-a770012b6798 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:29.026555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f2760400-f656-49b9-bc7c-a770012b6798 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1513 microversion: 2.1 time: 0.084191 Jul 15 15:55:29.027115 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 198/405] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:28 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1513 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:29.351786 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ffc9d803-1a49-40f9-98f7-1d64e1e0c2b8 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:29.352407 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ffc9d803-1a49-40f9-98f7-1d64e1e0c2b8 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:29.359517 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ffc9d803-1a49-40f9-98f7-1d64e1e0c2b8 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:29.361926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ffc9d803-1a49-40f9-98f7-1d64e1e0c2b8 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:29.361926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ffc9d803-1a49-40f9-98f7-1d64e1e0c2b8 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:29.361926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ffc9d803-1a49-40f9-98f7-1d64e1e0c2b8 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:29.432467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ffc9d803-1a49-40f9-98f7-1d64e1e0c2b8 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:29.442203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ffc9d803-1a49-40f9-98f7-1d64e1e0c2b8 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1459 microversion: 2.1 time: 0.094524 Jul 15 15:55:29.443013 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 208/406] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:29 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1459 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:29.725925 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a1e99ae8-ef5b-4890-bc18-282896e40029 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:29.726631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a1e99ae8-ef5b-4890-bc18-282896e40029 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:29.733966 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a1e99ae8-ef5b-4890-bc18-282896e40029 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:29.734423 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a1e99ae8-ef5b-4890-bc18-282896e40029 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:29.735200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a1e99ae8-ef5b-4890-bc18-282896e40029 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:29.735666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a1e99ae8-ef5b-4890-bc18-282896e40029 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:29.927924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a1e99ae8-ef5b-4890-bc18-282896e40029 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:29.957016 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a1e99ae8-ef5b-4890-bc18-282896e40029 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.234567 Jul 15 15:55:29.967377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 199/407] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:29 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:30.044153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5b879ef2-e0eb-4ca5-9a4e-883e9a42e2be tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:30.044805 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5b879ef2-e0eb-4ca5-9a4e-883e9a42e2be tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:30.053726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b879ef2-e0eb-4ca5-9a4e-883e9a42e2be tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:30.053726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b879ef2-e0eb-4ca5-9a4e-883e9a42e2be tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:30.053726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b879ef2-e0eb-4ca5-9a4e-883e9a42e2be tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:30.053726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b879ef2-e0eb-4ca5-9a4e-883e9a42e2be tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:30.124902 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5b879ef2-e0eb-4ca5-9a4e-883e9a42e2be tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:30.133566 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5b879ef2-e0eb-4ca5-9a4e-883e9a42e2be tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1346 microversion: 2.1 time: 0.093584 Jul 15 15:55:30.134140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 209/408] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:30 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:30.468994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:30.470046 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:30.476973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:30.477711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:30.478704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:30.479590 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:30.516085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:30.516085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:30.516507 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lazy-loading 'fault' on Instance uuid 67042be1-b8b2-471c-a64e-3819e5ed463a {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:55:30.562352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:30.570136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-198b1f33-fc43-4cdb-b435-e82a8d867ac7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1301 microversion: 2.1 time: 0.112839 Jul 15 15:55:30.570788 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 200/409] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:30 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1301 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:30.975176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ec2c087e-c796-414e-b9a5-641e36407ba2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:30.981555 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ec2c087e-c796-414e-b9a5-641e36407ba2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:30.988198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ec2c087e-c796-414e-b9a5-641e36407ba2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:30.988653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ec2c087e-c796-414e-b9a5-641e36407ba2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:30.989663 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ec2c087e-c796-414e-b9a5-641e36407ba2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:30.992226 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ec2c087e-c796-414e-b9a5-641e36407ba2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:31.150155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:31.150928 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:31.158059 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:31.158664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:31.159557 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:31.160056 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:31.173964 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ec2c087e-c796-414e-b9a5-641e36407ba2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:31.182619 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ec2c087e-c796-414e-b9a5-641e36407ba2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1519 microversion: 2.1 time: 0.211706 Jul 15 15:55:31.183373 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 210/410] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:30 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:31.209852 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:31.210296 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:31.210741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lazy-loading 'fault' on Instance uuid 3687d5cd-925a-43c4-a87e-a36664f4a2c1 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:55:31.257000 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:31.265808 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-44bb9531-3c14-4ffb-adeb-ab7896b890e1 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1351 microversion: 2.1 time: 0.119623 Jul 15 15:55:31.266378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 201/411] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:31 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:31.596341 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:31.597334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:31.612801 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:31.614045 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:31.616016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:31.618077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:31.661501 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:31.661878 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:31.662329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lazy-loading 'fault' on Instance uuid 67042be1-b8b2-471c-a64e-3819e5ed463a {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:55:31.711045 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:31.720264 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9174da41-e834-4574-ab23-96d12f543120 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 200 len: 1301 microversion: 2.1 time: 0.134108 Jul 15 15:55:31.721127 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 211/412] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:31 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 1301 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:32.202968 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-912142cc-6a2f-4111-8679-b8e9e0149dbe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:32.203655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-912142cc-6a2f-4111-8679-b8e9e0149dbe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:32.212706 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-912142cc-6a2f-4111-8679-b8e9e0149dbe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.213158 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-912142cc-6a2f-4111-8679-b8e9e0149dbe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.215739 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-912142cc-6a2f-4111-8679-b8e9e0149dbe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.215739 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-912142cc-6a2f-4111-8679-b8e9e0149dbe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.288886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:32.289734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:32.297207 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.297668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.298458 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.299030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.335559 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.336144 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.336711 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lazy-loading 'fault' on Instance uuid 3687d5cd-925a-43c4-a87e-a36664f4a2c1 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:55:32.394551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90cd544b0745809f118964cbdc66bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5644a8a1ae540e2b260c3d1bb2bea0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:32.409817 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6fd6b5ff-9968-4ddd-8f85-e2ad92212ed9 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 200 len: 1351 microversion: 2.1 time: 0.125319 Jul 15 15:55:32.411932 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 212/413] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:32 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:32.533223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-912142cc-6a2f-4111-8679-b8e9e0149dbe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:32.541719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-912142cc-6a2f-4111-8679-b8e9e0149dbe tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1499 microversion: 2.1 time: 0.344035 Jul 15 15:55:32.542531 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 202/414] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:32 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1499 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:32.558792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-694d5b33-1648-4a27-b88f-7cbe54574a1a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:32.559609 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-694d5b33-1648-4a27-b88f-7cbe54574a1a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:32.566761 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-694d5b33-1648-4a27-b88f-7cbe54574a1a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.573750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-694d5b33-1648-4a27-b88f-7cbe54574a1a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.573750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-694d5b33-1648-4a27-b88f-7cbe54574a1a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.573750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-694d5b33-1648-4a27-b88f-7cbe54574a1a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.737685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:32.738507 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 67042be1-b8b2-471c-a64e-3819e5ed463a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:32.748896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.751647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.753526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:32.753972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:32.775051 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-694d5b33-1648-4a27-b88f-7cbe54574a1a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:32.784153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-694d5b33-1648-4a27-b88f-7cbe54574a1a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1516 microversion: 2.1 time: 0.229305 Jul 15 15:55:32.784758 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 213/415] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:32 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:32.798974 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] HTTP exception thrown: Instance 67042be1-b8b2-471c-a64e-3819e5ed463a could not be found. Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Request method failure captured: Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a HTTP/1.1 Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y27nPNxQBbDl8mI4_dSK-ejZt4HKOfKHIDhuOCR9AOgqSUddEts_I9JR5AOLfnF3fwaTTTR6oY9OcicAluGorPj5k1JN5VU3nmrWaZLm2dnd-VAFaFdpuk7SWbmGDYgs4684NspgbvceZ9NfD8YxTmKcSakZO7JogccUvEX7zOIdYE Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 8d7726f6c7444f16ac5ea9696eacdf57 Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-VolumesActionsTest-806726835 Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:55:32.809545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8d7726f6c7444f16ac5ea9696eacdf57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8d7726f6c7444f16ac5ea9696eacdf57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8d7726f6c7444f16ac5ea9696eacdf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8d7726f6c7444f16ac5ea9696eacdf57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-VolumesActionsTest-806726835 Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 8d7726f6c7444f16ac5ea9696eacdf57 Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-VolumesActionsTest-806726835 Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-VolumesActionsTest-806726835-project Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: a3efd91d94b44c6aa41087c2f017861f Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-VolumesActionsTest-806726835-project Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 67042be1-b8b2-471c-a64e-3819e5ed463a could not be found. Jul 15 15:55:32.810874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '67042be1-b8b2-471c-a64e-3819e5ed463a'} Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67042be1-b8b2-471c-a64e-3819e5ed463a could not be found. Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:55:32.811689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67042be1-b8b2-471c-a64e-3819e5ed463a could not be found. Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67042be1-b8b2-471c-a64e-3819e5ed463a could not be found. Jul 15 15:55:32.813027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:32.814080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Returning 404 to user: Instance 67042be1-b8b2-471c-a64e-3819e5ed463a could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:55:32.814080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8b21aee5-5b19-4772-89a1-0c63fc670823 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a" status: 404 len: 111 microversion: 2.1 time: 0.071776 Jul 15 15:55:32.814080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 203/416] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:32 2022] GET /compute/v2.1/servers/67042be1-b8b2-471c-a64e-3819e5ed463a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:55:32.934823 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-996433981", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "networks": [{"uuid": "b33ee347-5a0b-4a94-a69b-b9d48b921848"}]}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:32.993326 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] validate_networks() for [('b33ee347-5a0b-4a94-a69b-b9d48b921848', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:55:33.429060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:33.429665 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:33.438898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:33.439646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:33.440774 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:33.441650 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:33.458921 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] HTTP exception thrown: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Request method failure captured: Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 HTTP/1.1 Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y13BDXL9RPJ2vbievBvjP4r_qETCYS9dPeM_IhUyEz-E61KJUM5KIwDKFcEeFL5p2nsAAb4duaQ3ZLz61nmLGOhYJ0yOSxjS-wDGBojz5IRx0beO72_EHjOapv6jpjoXmHjZp7BExB7skkhrwG0Sm_Kk7Lwu1h60S59PTjty9cemYI Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: a5644a8a1ae540e2b260c3d1bb2bea0f Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:55:33.460755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: a5644a8a1ae540e2b260c3d1bb2bea0f Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-DeleteServersTestJSON-1404481275-project Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 8e90cd544b0745809f118964cbdc66bb Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-DeleteServersTestJSON-1404481275-project Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.462151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '3687d5cd-925a-43c4-a87e-a36664f4a2c1'} Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:55:33.462989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.465516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.468330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Returning 404 to user: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:55:33.469352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0a4cfb02-7cbf-47ad-97bb-35b3fa56cb73 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 404 len: 111 microversion: 2.1 time: 0.044250 Jul 15 15:55:33.470089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 204/417] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:33 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:55:33.493840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:55:33.494317 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:55:33.494943 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:55:33.495484 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:55:33.495956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:55:33.507483 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:33.508214 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:33.509428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:33.510279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:33.529636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Getting quotas for project 8d7726f6c7444f16ac5ea9696eacdf57. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:55:33.533748 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Getting quotas for user a3efd91d94b44c6aa41087c2f017861f and project 8d7726f6c7444f16ac5ea9696eacdf57. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:55:33.546458 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:55:33.548920 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:55:33.589028 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:33.590245 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:33.596365 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:33.596817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:33.597583 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:33.598022 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:33.611370 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] HTTP exception thrown: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Request method failure captured: Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1/os-volume_attachments HTTP/1.1 Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y13BDXL9RPJ2vbievBvjP4r_qETCYS9dPeM_IhUyEz-E61KJUM5KIwDKFcEeFL5p2nsAAb4duaQ3ZLz61nmLGOhYJ0yOSxjS-wDGBojz5IRx0beO72_EHjOapv6jpjoXmHjZp7BExB7skkhrwG0Sm_Kk7Lwu1h60S59PTjty9cemYI Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: a5644a8a1ae540e2b260c3d1bb2bea0f Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:55:33.613014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: a5644a8a1ae540e2b260c3d1bb2bea0f Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-DeleteServersTestJSON-1404481275-project Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 8e90cd544b0745809f118964cbdc66bb Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-DeleteServersTestJSON-1404481275-project Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.614527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'server_id': '3687d5cd-925a-43c4-a87e-a36664f4a2c1'} Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:55:33.615256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:33.616412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:33.617475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Returning 404 to user: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:55:33.617475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-bbb16c11-081a-44c0-8251-fe6ffce591f0 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029566 Jul 15 15:55:33.617475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 205/418] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 15:55:33 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 15:55:33.749467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fe04c3e1-e150-46a9-bcb8-21bd66fe70a4 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818859 Jul 15 15:55:33.756551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 214/419] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:55:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:55:33.761445 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a7c449ca-42a9-47fb-9b73-6a7a6f6f4375 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:33.765188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a7c449ca-42a9-47fb-9b73-6a7a6f6f4375 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:33.861099 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a7c449ca-42a9-47fb-9b73-6a7a6f6f4375 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:33.870618 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a7c449ca-42a9-47fb-9b73-6a7a6f6f4375 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1213 microversion: 2.1 time: 0.111849 Jul 15 15:55:33.872058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 206/420] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:33 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:34.893399 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8eab87b4-35e3-40f4-9c38-b9b1206f2395 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:34.893399 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8eab87b4-35e3-40f4-9c38-b9b1206f2395 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:34.913852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8eab87b4-35e3-40f4-9c38-b9b1206f2395 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:34.914304 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8eab87b4-35e3-40f4-9c38-b9b1206f2395 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:34.918737 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8eab87b4-35e3-40f4-9c38-b9b1206f2395 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:34.919279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8eab87b4-35e3-40f4-9c38-b9b1206f2395 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:35.028434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:35.031902 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:35.040587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:35.041574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:35.047690 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8eab87b4-35e3-40f4-9c38-b9b1206f2395 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:35.048276 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:35.049330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:35.069268 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8eab87b4-35e3-40f4-9c38-b9b1206f2395 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1217 microversion: 2.1 time: 0.181991 Jul 15 15:55:35.071396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 215/421] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:34 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:35.071515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] HTTP exception thrown: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Request method failure captured: Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 HTTP/1.1 Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y13BDXL9RPJ2vbievBvjP4r_qETCYS9dPeM_IhUyEz-E61KJUM5KIwDKFcEeFL5p2nsAAb4duaQ3ZLz61nmLGOhYJ0yOSxjS-wDGBojz5IRx0beO72_EHjOapv6jpjoXmHjZp7BExB7skkhrwG0Sm_Kk7Lwu1h60S59PTjty9cemYI Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: a5644a8a1ae540e2b260c3d1bb2bea0f Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:55:35.073192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: a5644a8a1ae540e2b260c3d1bb2bea0f Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-DeleteServersTestJSON-1404481275-project Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 8e90cd544b0745809f118964cbdc66bb Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-DeleteServersTestJSON-1404481275-project Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.078822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '3687d5cd-925a-43c4-a87e-a36664f4a2c1'} Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:55:35.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.080667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.081793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Returning 404 to user: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:55:35.081793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-241d20a4-f228-4230-b348-e5d23dee64a8 tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 404 len: 111 microversion: 2.1 time: 0.054220 Jul 15 15:55:35.081793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 207/422] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 15:55:35 2022] DELETE /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 15:55:35.085469 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:35.086090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] [instance: 3687d5cd-925a-43c4-a87e-a36664f4a2c1] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:35.092865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:35.093314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:35.094095 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:35.094537 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:35.110417 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] HTTP exception thrown: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Request method failure captured: Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 HTTP/1.1 Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y13BDXL9RPJ2vbievBvjP4r_qETCYS9dPeM_IhUyEz-E61KJUM5KIwDKFcEeFL5p2nsAAb4duaQ3ZLz61nmLGOhYJ0yOSxjS-wDGBojz5IRx0beO72_EHjOapv6jpjoXmHjZp7BExB7skkhrwG0Sm_Kk7Lwu1h60S59PTjty9cemYI Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: a5644a8a1ae540e2b260c3d1bb2bea0f Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 15:55:35.115495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a5644a8a1ae540e2b260c3d1bb2bea0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: a5644a8a1ae540e2b260c3d1bb2bea0f Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-DeleteServersTestJSON-1404481275 Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-DeleteServersTestJSON-1404481275-project Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 8e90cd544b0745809f118964cbdc66bb Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-DeleteServersTestJSON-1404481275-project Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.119220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '3687d5cd-925a-43c4-a87e-a36664f4a2c1'} Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:55:35.119945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. Jul 15 15:55:35.121008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:55:35.122641 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] Returning 404 to user: Instance 3687d5cd-925a-43c4-a87e-a36664f4a2c1 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:55:35.122641 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-67b612d7-52a7-4d6f-823e-597b7fd4befd tempest-DeleteServersTestJSON-1404481275 tempest-DeleteServersTestJSON-1404481275-project] 10.222.0.98 "GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1" status: 404 len: 111 microversion: 2.1 time: 0.037220 Jul 15 15:55:35.122641 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 216/423] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:35 2022] GET /compute/v2.1/servers/3687d5cd-925a-43c4-a87e-a36664f4a2c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:55:35.848611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c9a5f2b4-5f17-4ea6-876a-1dc48e098a1e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:35.849635 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c9a5f2b4-5f17-4ea6-876a-1dc48e098a1e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:35.856223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c9a5f2b4-5f17-4ea6-876a-1dc48e098a1e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:35.856679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c9a5f2b4-5f17-4ea6-876a-1dc48e098a1e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:35.857541 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c9a5f2b4-5f17-4ea6-876a-1dc48e098a1e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:35.857996 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c9a5f2b4-5f17-4ea6-876a-1dc48e098a1e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:35.885233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-c9a5f2b4-5f17-4ea6-876a-1dc48e098a1e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'flavor' on Instance uuid 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:55:36.092467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3ac47756-0f7f-41fa-8e7c-f57507fa5486 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:36.092467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3ac47756-0f7f-41fa-8e7c-f57507fa5486 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:36.099535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3ac47756-0f7f-41fa-8e7c-f57507fa5486 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:36.099998 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3ac47756-0f7f-41fa-8e7c-f57507fa5486 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:36.100795 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3ac47756-0f7f-41fa-8e7c-f57507fa5486 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:36.101570 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3ac47756-0f7f-41fa-8e7c-f57507fa5486 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:36.163614 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:36.206485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3ac47756-0f7f-41fa-8e7c-f57507fa5486 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:36.226625 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3ac47756-0f7f-41fa-8e7c-f57507fa5486 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1265 microversion: 2.1 time: 0.142096 Jul 15 15:55:36.238147 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 217/424] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:36 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:36.401101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c9a5f2b4-5f17-4ea6-876a-1dc48e098a1e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5/action" status: 200 len: 32 microversion: 2.1 time: 0.556434 Jul 15 15:55:36.401772 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 208/425] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:55:35 2022] POST /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5/action => generated 32 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:55:36.417285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fe488c0a-f532-4c56-a818-1e09ba2de5fd tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:36.424218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fe488c0a-f532-4c56-a818-1e09ba2de5fd tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:36.431365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe488c0a-f532-4c56-a818-1e09ba2de5fd tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:36.432046 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe488c0a-f532-4c56-a818-1e09ba2de5fd tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:36.436651 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe488c0a-f532-4c56-a818-1e09ba2de5fd tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:36.436651 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe488c0a-f532-4c56-a818-1e09ba2de5fd tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:36.619003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fe488c0a-f532-4c56-a818-1e09ba2de5fd tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:36.628520 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fe488c0a-f532-4c56-a818-1e09ba2de5fd tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.215773 Jul 15 15:55:36.640166 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 218/426] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:36 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:37.247828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3fe3852e-20f1-4664-8bcd-9b39ca81a057 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:37.248824 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3fe3852e-20f1-4664-8bcd-9b39ca81a057 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:37.259715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3fe3852e-20f1-4664-8bcd-9b39ca81a057 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:37.260539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3fe3852e-20f1-4664-8bcd-9b39ca81a057 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:37.261460 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3fe3852e-20f1-4664-8bcd-9b39ca81a057 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:37.262241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3fe3852e-20f1-4664-8bcd-9b39ca81a057 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:37.369100 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3fe3852e-20f1-4664-8bcd-9b39ca81a057 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:37.398845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3fe3852e-20f1-4664-8bcd-9b39ca81a057 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1283 microversion: 2.1 time: 0.157657 Jul 15 15:55:37.411954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 209/427] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:37 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:37.648661 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8902a81b-c0b6-4bb3-b6cd-8c032ef69228 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:37.650437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8902a81b-c0b6-4bb3-b6cd-8c032ef69228 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:37.678025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8902a81b-c0b6-4bb3-b6cd-8c032ef69228 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:37.686661 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8902a81b-c0b6-4bb3-b6cd-8c032ef69228 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:37.689892 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8902a81b-c0b6-4bb3-b6cd-8c032ef69228 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:37.690360 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8902a81b-c0b6-4bb3-b6cd-8c032ef69228 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:38.174219 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8902a81b-c0b6-4bb3-b6cd-8c032ef69228 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:38.182092 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8902a81b-c0b6-4bb3-b6cd-8c032ef69228 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.539790 Jul 15 15:55:38.189507 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 219/428] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:37 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:38.418687 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e6401c86-bca5-42bb-9e17-5cffcc532357 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:38.420292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e6401c86-bca5-42bb-9e17-5cffcc532357 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:38.428184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e6401c86-bca5-42bb-9e17-5cffcc532357 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:38.428970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e6401c86-bca5-42bb-9e17-5cffcc532357 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:38.430469 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e6401c86-bca5-42bb-9e17-5cffcc532357 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:38.433151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e6401c86-bca5-42bb-9e17-5cffcc532357 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:38.631776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e6401c86-bca5-42bb-9e17-5cffcc532357 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:38.649008 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e6401c86-bca5-42bb-9e17-5cffcc532357 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1271 microversion: 2.1 time: 0.234541 Jul 15 15:55:38.650823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 210/429] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:38 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:39.202979 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-78b9c903-bb89-4bcc-82e4-efd1c0c66f54 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:39.203636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-78b9c903-bb89-4bcc-82e4-efd1c0c66f54 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:39.220071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-78b9c903-bb89-4bcc-82e4-efd1c0c66f54 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:39.220541 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-78b9c903-bb89-4bcc-82e4-efd1c0c66f54 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:39.221353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-78b9c903-bb89-4bcc-82e4-efd1c0c66f54 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:39.224735 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-78b9c903-bb89-4bcc-82e4-efd1c0c66f54 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:39.484390 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-78b9c903-bb89-4bcc-82e4-efd1c0c66f54 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:39.495611 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-78b9c903-bb89-4bcc-82e4-efd1c0c66f54 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.297345 Jul 15 15:55:39.496787 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 220/430] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:39 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:39.668629 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-afcad6c4-5703-4a38-bf84-ee56f78b651a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:39.669658 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-afcad6c4-5703-4a38-bf84-ee56f78b651a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:39.680618 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-afcad6c4-5703-4a38-bf84-ee56f78b651a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:39.682226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-afcad6c4-5703-4a38-bf84-ee56f78b651a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:39.707912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-afcad6c4-5703-4a38-bf84-ee56f78b651a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:39.707912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-afcad6c4-5703-4a38-bf84-ee56f78b651a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:40.004778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-afcad6c4-5703-4a38-bf84-ee56f78b651a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:40.012266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-afcad6c4-5703-4a38-bf84-ee56f78b651a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.348112 Jul 15 15:55:40.012840 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 211/431] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:39 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:40.515400 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3641e2bf-e6e3-431e-9448-4b258ba92e49 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:40.516238 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3641e2bf-e6e3-431e-9448-4b258ba92e49 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:40.531320 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3641e2bf-e6e3-431e-9448-4b258ba92e49 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:40.531855 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3641e2bf-e6e3-431e-9448-4b258ba92e49 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:40.533969 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3641e2bf-e6e3-431e-9448-4b258ba92e49 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:40.534422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3641e2bf-e6e3-431e-9448-4b258ba92e49 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:40.845171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-f5e10bd5-d9bc-49b7-8093-c3e24027acbf req-0e8a91c8-d924-42de-82f2-c939b1d243fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11221205-c6d9-4968-ab79-bc19b19fa3f7", "tag": "6b88d5b0-876f-44b7-bdfe-d150297d5251"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:40.859438 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f5e10bd5-d9bc-49b7-8093-c3e24027acbf req-0e8a91c8-d924-42de-82f2-c939b1d243fc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:40.859887 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f5e10bd5-d9bc-49b7-8093-c3e24027acbf req-0e8a91c8-d924-42de-82f2-c939b1d243fc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:40.874392 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-f5e10bd5-d9bc-49b7-8093-c3e24027acbf req-0e8a91c8-d924-42de-82f2-c939b1d243fc service nova] Creating event network-changed:6b88d5b0-876f-44b7-bdfe-d150297d5251 for instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 on hv-cinder-83587 Jul 15 15:55:40.880998 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-f5e10bd5-d9bc-49b7-8093-c3e24027acbf req-0e8a91c8-d924-42de-82f2-c939b1d243fc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041102 Jul 15 15:55:40.881869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 212/432] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:55:40.966598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3641e2bf-e6e3-431e-9448-4b258ba92e49 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:40.981978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3641e2bf-e6e3-431e-9448-4b258ba92e49 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.470178 Jul 15 15:55:40.983253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 221/433] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:40 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:41.045698 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b4d5bbfc-7033-45fc-8dab-f6cd16693f0e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:41.048651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b4d5bbfc-7033-45fc-8dab-f6cd16693f0e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:41.057541 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b4d5bbfc-7033-45fc-8dab-f6cd16693f0e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:41.058193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b4d5bbfc-7033-45fc-8dab-f6cd16693f0e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:41.062163 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b4d5bbfc-7033-45fc-8dab-f6cd16693f0e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:41.062735 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b4d5bbfc-7033-45fc-8dab-f6cd16693f0e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:41.892210 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b4d5bbfc-7033-45fc-8dab-f6cd16693f0e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:41.900045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b4d5bbfc-7033-45fc-8dab-f6cd16693f0e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.873646 Jul 15 15:55:41.909276 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 213/434] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:41 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:42.006676 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2b9bc831-c95e-4524-b84d-473edfadda77 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:42.008614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2b9bc831-c95e-4524-b84d-473edfadda77 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:42.011792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:42.017593 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b9bc831-c95e-4524-b84d-473edfadda77 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:42.020336 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b9bc831-c95e-4524-b84d-473edfadda77 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:42.020336 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b9bc831-c95e-4524-b84d-473edfadda77 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:42.020336 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b9bc831-c95e-4524-b84d-473edfadda77 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:42.204171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2b9bc831-c95e-4524-b84d-473edfadda77 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:42.211721 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2b9bc831-c95e-4524-b84d-473edfadda77 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.210640 Jul 15 15:55:42.212289 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 222/435] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:41 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:42.920055 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8036196f-2bc8-4347-8824-75066b34cfce tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:42.921268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8036196f-2bc8-4347-8824-75066b34cfce tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:42.929078 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8036196f-2bc8-4347-8824-75066b34cfce tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:42.930375 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8036196f-2bc8-4347-8824-75066b34cfce tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:42.931416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8036196f-2bc8-4347-8824-75066b34cfce tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:42.932043 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8036196f-2bc8-4347-8824-75066b34cfce tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:43.106498 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8036196f-2bc8-4347-8824-75066b34cfce tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:43.123233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8036196f-2bc8-4347-8824-75066b34cfce tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.208798 Jul 15 15:55:43.125452 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 214/436] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:42 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:43.229928 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2b0794e0-570b-4fea-afe0-d87a7be4541a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:43.230580 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2b0794e0-570b-4fea-afe0-d87a7be4541a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:43.238455 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b0794e0-570b-4fea-afe0-d87a7be4541a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:43.238910 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b0794e0-570b-4fea-afe0-d87a7be4541a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:43.239720 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b0794e0-570b-4fea-afe0-d87a7be4541a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:43.240169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b0794e0-570b-4fea-afe0-d87a7be4541a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:43.261883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:43.474428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2b0794e0-570b-4fea-afe0-d87a7be4541a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:43.482116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2b0794e0-570b-4fea-afe0-d87a7be4541a tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.256052 Jul 15 15:55:43.492564 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 223/437] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:43 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:44.149428 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9326fbcf-5f6a-44fe-a7c9-7135b46ecc27 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:44.150746 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9326fbcf-5f6a-44fe-a7c9-7135b46ecc27 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:44.163709 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:44.165760 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9326fbcf-5f6a-44fe-a7c9-7135b46ecc27 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:44.166550 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9326fbcf-5f6a-44fe-a7c9-7135b46ecc27 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:44.167910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9326fbcf-5f6a-44fe-a7c9-7135b46ecc27 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:44.168697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9326fbcf-5f6a-44fe-a7c9-7135b46ecc27 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:44.336776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9326fbcf-5f6a-44fe-a7c9-7135b46ecc27 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:44.345273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9326fbcf-5f6a-44fe-a7c9-7135b46ecc27 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.201842 Jul 15 15:55:44.345871 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 215/438] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:44 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:44.499598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d03df222-7eb0-4462-902f-2fd2d22f2d86 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:44.500213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d03df222-7eb0-4462-902f-2fd2d22f2d86 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:44.502303 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:44.502957 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=6 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:44.508824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d03df222-7eb0-4462-902f-2fd2d22f2d86 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:44.509280 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d03df222-7eb0-4462-902f-2fd2d22f2d86 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:44.510044 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d03df222-7eb0-4462-902f-2fd2d22f2d86 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:44.510481 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d03df222-7eb0-4462-902f-2fd2d22f2d86 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:44.692190 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d03df222-7eb0-4462-902f-2fd2d22f2d86 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:44.703717 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d03df222-7eb0-4462-902f-2fd2d22f2d86 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.208869 Jul 15 15:55:44.704317 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 224/439] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:44 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:45.365190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b7d3da5c-e86a-422b-95c2-879429d41520 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:45.366497 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b7d3da5c-e86a-422b-95c2-879429d41520 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:45.373846 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=78 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:45.377231 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b7d3da5c-e86a-422b-95c2-879429d41520 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:45.377979 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b7d3da5c-e86a-422b-95c2-879429d41520 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:45.388433 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b7d3da5c-e86a-422b-95c2-879429d41520 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:45.389223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b7d3da5c-e86a-422b-95c2-879429d41520 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:45.727825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8e24df05-e2a4-4d6d-bc56-d6694c81956b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:45.728937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8e24df05-e2a4-4d6d-bc56-d6694c81956b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:45.772870 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8e24df05-e2a4-4d6d-bc56-d6694c81956b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:45.777843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8e24df05-e2a4-4d6d-bc56-d6694c81956b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:45.777843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8e24df05-e2a4-4d6d-bc56-d6694c81956b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:45.777843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8e24df05-e2a4-4d6d-bc56-d6694c81956b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:45.914187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b7d3da5c-e86a-422b-95c2-879429d41520 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:45.923021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b7d3da5c-e86a-422b-95c2-879429d41520 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.564060 Jul 15 15:55:45.932060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 216/440] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:45 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:46.212755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8e24df05-e2a4-4d6d-bc56-d6694c81956b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:46.228459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8e24df05-e2a4-4d6d-bc56-d6694c81956b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.510026 Jul 15 15:55:46.229557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 225/441] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:45 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:46.945906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-07aa290a-713f-4805-b601-4260eb5c436e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:46.946632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-07aa290a-713f-4805-b601-4260eb5c436e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:46.952795 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07aa290a-713f-4805-b601-4260eb5c436e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:46.953326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07aa290a-713f-4805-b601-4260eb5c436e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:46.954207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07aa290a-713f-4805-b601-4260eb5c436e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:46.954864 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07aa290a-713f-4805-b601-4260eb5c436e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:47.121550 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-07aa290a-713f-4805-b601-4260eb5c436e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:47.137690 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-07aa290a-713f-4805-b601-4260eb5c436e tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.195926 Jul 15 15:55:47.139272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 217/442] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:46 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:47.246814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-db2eb020-dccd-4119-be30-ae2f6531325c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:47.247522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-db2eb020-dccd-4119-be30-ae2f6531325c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:47.254288 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db2eb020-dccd-4119-be30-ae2f6531325c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:47.254736 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db2eb020-dccd-4119-be30-ae2f6531325c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:47.255618 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db2eb020-dccd-4119-be30-ae2f6531325c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:47.256105 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db2eb020-dccd-4119-be30-ae2f6531325c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:47.522584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-db2eb020-dccd-4119-be30-ae2f6531325c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:47.546900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-db2eb020-dccd-4119-be30-ae2f6531325c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.304698 Jul 15 15:55:47.547578 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 226/443] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:47 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:48.159196 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b2fe7fdc-c963-4a95-ba80-092b4bfaf358 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:48.159993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b2fe7fdc-c963-4a95-ba80-092b4bfaf358 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:48.172359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b2fe7fdc-c963-4a95-ba80-092b4bfaf358 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:48.173047 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b2fe7fdc-c963-4a95-ba80-092b4bfaf358 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:48.174067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b2fe7fdc-c963-4a95-ba80-092b4bfaf358 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:48.174880 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b2fe7fdc-c963-4a95-ba80-092b4bfaf358 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:48.454911 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b2fe7fdc-c963-4a95-ba80-092b4bfaf358 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:48.465831 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b2fe7fdc-c963-4a95-ba80-092b4bfaf358 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.310072 Jul 15 15:55:48.466643 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 218/444] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:48 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:48.566216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-aab72359-eb06-41ca-a0b0-b4f39c528b6b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:48.566990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-aab72359-eb06-41ca-a0b0-b4f39c528b6b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:48.577126 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-01f7e809-8f55-4895-9ac1-1687c3781ac2 req-ad9e82dd-1162-4c7a-b2f5-9deb86dc3970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11221205-c6d9-4968-ab79-bc19b19fa3f7", "name": "network-vif-plugged", "status": "completed", "tag": "6b88d5b0-876f-44b7-bdfe-d150297d5251"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:48.605587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-01f7e809-8f55-4895-9ac1-1687c3781ac2 req-ad9e82dd-1162-4c7a-b2f5-9deb86dc3970 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:48.606896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-aab72359-eb06-41ca-a0b0-b4f39c528b6b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:48.607676 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-aab72359-eb06-41ca-a0b0-b4f39c528b6b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:48.609046 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-aab72359-eb06-41ca-a0b0-b4f39c528b6b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:48.609945 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-01f7e809-8f55-4895-9ac1-1687c3781ac2 req-ad9e82dd-1162-4c7a-b2f5-9deb86dc3970 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:48.611173 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-aab72359-eb06-41ca-a0b0-b4f39c528b6b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:48.660290 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-01f7e809-8f55-4895-9ac1-1687c3781ac2 req-ad9e82dd-1162-4c7a-b2f5-9deb86dc3970 service nova] Creating event network-vif-plugged:6b88d5b0-876f-44b7-bdfe-d150297d5251 for instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 on hv-cinder-83587 Jul 15 15:55:48.680431 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-01f7e809-8f55-4895-9ac1-1687c3781ac2 req-ad9e82dd-1162-4c7a-b2f5-9deb86dc3970 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109029 Jul 15 15:55:48.685955 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 219/445] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:55:48.947861 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-aab72359-eb06-41ca-a0b0-b4f39c528b6b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:48.961965 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-aab72359-eb06-41ca-a0b0-b4f39c528b6b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.400930 Jul 15 15:55:48.965128 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 227/446] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:48 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:49.490477 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-01d2d99d-f942-41d9-8321-4bf0d211dc4a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:49.490477 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-01d2d99d-f942-41d9-8321-4bf0d211dc4a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:49.509794 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-01d2d99d-f942-41d9-8321-4bf0d211dc4a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:49.513263 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-01d2d99d-f942-41d9-8321-4bf0d211dc4a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:49.516289 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-01d2d99d-f942-41d9-8321-4bf0d211dc4a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:49.516867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-01d2d99d-f942-41d9-8321-4bf0d211dc4a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:49.972933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-01d2d99d-f942-41d9-8321-4bf0d211dc4a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:49.982087 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a1576161-971e-4a91-b495-f9a27ebaca05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:49.985333 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a1576161-971e-4a91-b495-f9a27ebaca05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:49.994269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-01d2d99d-f942-41d9-8321-4bf0d211dc4a tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.511089 Jul 15 15:55:49.999679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a1576161-971e-4a91-b495-f9a27ebaca05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:50.000223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 220/447] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:49 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:50.000687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a1576161-971e-4a91-b495-f9a27ebaca05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:50.001762 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a1576161-971e-4a91-b495-f9a27ebaca05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:50.002431 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a1576161-971e-4a91-b495-f9a27ebaca05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:50.171684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a1576161-971e-4a91-b495-f9a27ebaca05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:50.180406 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a1576161-971e-4a91-b495-f9a27ebaca05 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1502 microversion: 2.1 time: 0.203036 Jul 15 15:55:50.181538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 228/448] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:49 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:50.197167 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd55bec5-6f92-442b-9318-66efbdb0f076"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:50.199017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:50.205434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:50.206130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:50.206906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:50.207370 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:50.250623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] HTTP exception thrown: Cannot 'attach_volume' instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 while it is in vm_state rescued Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Request method failure captured: Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: POST /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5/os-volume_attachments HTTP/1.1 Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 74 Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y10DzbCS3DQTJU_gOOd285DZTxYv1yhcYcCSsQgBFQAGtklPsOguTMShhZJ5Ew7xUEU6GJKnp-xBWPYGp3VznxicKE-i7ZE6HMPq8QSBFfrHO1UjcinhOzqEORciPh99KYHoGPoluej5qLBpDvS1Y3G68GwOhTLuHfT-xYlD-__kA4 Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:55:50.252630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 9005cb23317a4a05b58e99284824135e Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {"volumeAttachment": {"volumeId": "cd55bec5-6f92-442b-9318-66efbdb0f076"}} Jul 15 15:55:50.254185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Cannot 'attach_volume' instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 while it is in vm_state rescued Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'server_id': '1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5', 'body': {'volumeAttachment': {'volumeId': 'cd55bec5-6f92-442b-9318-66efbdb0f076'}}} Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:55:50.267726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 while it is in vm_state rescued Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:55:50.268811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:55:50.270453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:55:50.270453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:55:50.270453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 while it is in vm_state rescued Jul 15 15:55:50.270453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:55:50.270453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Returning 409 to user: Cannot 'attach_volume' instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 while it is in vm_state rescued {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:55:50.270453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-520be747-aff7-44a3-a420-55df4780c5f2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072040 Jul 15 15:55:50.270453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 221/449] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 15:55:50 2022] POST /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 15:55:50.274476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1769cad4-708d-485f-ac8a-716bf8d5b726 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:50.275017 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1769cad4-708d-485f-ac8a-716bf8d5b726 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:50.281301 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1769cad4-708d-485f-ac8a-716bf8d5b726 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:50.281759 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1769cad4-708d-485f-ac8a-716bf8d5b726 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:50.282560 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1769cad4-708d-485f-ac8a-716bf8d5b726 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:50.282999 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1769cad4-708d-485f-ac8a-716bf8d5b726 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:50.598995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1769cad4-708d-485f-ac8a-716bf8d5b726 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5/action" status: 202 len: 0 microversion: 2.1 time: 0.328054 Jul 15 15:55:50.604420 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 229/450] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:55:50 2022] POST /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:55:50.609819 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c957e2c7-4251-4e42-afe6-14266e0e372d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:50.610431 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c957e2c7-4251-4e42-afe6-14266e0e372d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:50.619175 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c957e2c7-4251-4e42-afe6-14266e0e372d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:50.623484 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c957e2c7-4251-4e42-afe6-14266e0e372d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:50.624607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c957e2c7-4251-4e42-afe6-14266e0e372d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:50.625214 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c957e2c7-4251-4e42-afe6-14266e0e372d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:51.028540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c6c7f9bf-666f-43a4-a43e-334e3f9c9391 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:51.028540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c6c7f9bf-666f-43a4-a43e-334e3f9c9391 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:51.032289 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6c7f9bf-666f-43a4-a43e-334e3f9c9391 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:51.033145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6c7f9bf-666f-43a4-a43e-334e3f9c9391 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:51.035342 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6c7f9bf-666f-43a4-a43e-334e3f9c9391 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:51.037019 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6c7f9bf-666f-43a4-a43e-334e3f9c9391 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:51.185109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c957e2c7-4251-4e42-afe6-14266e0e372d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:51.193541 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c957e2c7-4251-4e42-afe6-14266e0e372d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1510 microversion: 2.1 time: 0.587532 Jul 15 15:55:51.200361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 222/451] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:50 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1510 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:51.335044 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c6c7f9bf-666f-43a4-a43e-334e3f9c9391 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:51.351631 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c6c7f9bf-666f-43a4-a43e-334e3f9c9391 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.334226 Jul 15 15:55:51.352638 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 230/452] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:51 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:52.217887 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-87072a76-5b86-471c-8837-6d07ff3c3a3d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:52.218998 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-87072a76-5b86-471c-8837-6d07ff3c3a3d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:52.226648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-87072a76-5b86-471c-8837-6d07ff3c3a3d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:52.233195 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-87072a76-5b86-471c-8837-6d07ff3c3a3d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:52.234224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-87072a76-5b86-471c-8837-6d07ff3c3a3d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:52.234795 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-87072a76-5b86-471c-8837-6d07ff3c3a3d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:52.375613 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5205e4d7-60bf-4ff5-b6d6-1c52192c4c36 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:52.376929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5205e4d7-60bf-4ff5-b6d6-1c52192c4c36 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:52.394285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5205e4d7-60bf-4ff5-b6d6-1c52192c4c36 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:52.394991 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5205e4d7-60bf-4ff5-b6d6-1c52192c4c36 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:52.398526 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5205e4d7-60bf-4ff5-b6d6-1c52192c4c36 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:52.402381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5205e4d7-60bf-4ff5-b6d6-1c52192c4c36 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:52.679740 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5205e4d7-60bf-4ff5-b6d6-1c52192c4c36 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:52.690182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5205e4d7-60bf-4ff5-b6d6-1c52192c4c36 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1313 microversion: 2.1 time: 0.324624 Jul 15 15:55:52.706598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 231/453] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:52 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:52.827569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-87072a76-5b86-471c-8837-6d07ff3c3a3d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:52.858605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-87072a76-5b86-471c-8837-6d07ff3c3a3d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1510 microversion: 2.1 time: 0.626878 Jul 15 15:55:52.858605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 223/454] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:52 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1510 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:53.710869 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-02742f04-6eea-4d39-bba2-39ce957db4f7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:53.711575 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-02742f04-6eea-4d39-bba2-39ce957db4f7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:53.719731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-02742f04-6eea-4d39-bba2-39ce957db4f7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:53.720179 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-02742f04-6eea-4d39-bba2-39ce957db4f7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:53.720952 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-02742f04-6eea-4d39-bba2-39ce957db4f7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:53.721383 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-02742f04-6eea-4d39-bba2-39ce957db4f7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:53.865354 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-808536c7-c531-4f5a-ac04-54f58d4ad863 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:53.871026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-808536c7-c531-4f5a-ac04-54f58d4ad863 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:53.880800 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-808536c7-c531-4f5a-ac04-54f58d4ad863 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:53.883075 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-808536c7-c531-4f5a-ac04-54f58d4ad863 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:53.884073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-808536c7-c531-4f5a-ac04-54f58d4ad863 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:53.884524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-808536c7-c531-4f5a-ac04-54f58d4ad863 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:53.901086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-02742f04-6eea-4d39-bba2-39ce957db4f7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:53.929670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-02742f04-6eea-4d39-bba2-39ce957db4f7 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1496 microversion: 2.1 time: 0.212729 Jul 15 15:55:53.929670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 232/455] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:53 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1496 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:54.222502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-808536c7-c531-4f5a-ac04-54f58d4ad863 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:54.238960 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-808536c7-c531-4f5a-ac04-54f58d4ad863 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1510 microversion: 2.1 time: 0.377494 Jul 15 15:55:54.246700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 224/456] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:53 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1510 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:55.266749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f3c44002-867b-43b5-b3d9-2b7266577fe0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:55.268570 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f3c44002-867b-43b5-b3d9-2b7266577fe0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:55.290835 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f3c44002-867b-43b5-b3d9-2b7266577fe0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:55.297649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f3c44002-867b-43b5-b3d9-2b7266577fe0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:55.304254 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f3c44002-867b-43b5-b3d9-2b7266577fe0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:55.304711 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f3c44002-867b-43b5-b3d9-2b7266577fe0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:55.668739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f3c44002-867b-43b5-b3d9-2b7266577fe0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:55.714616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f3c44002-867b-43b5-b3d9-2b7266577fe0 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1510 microversion: 2.1 time: 0.452467 Jul 15 15:55:55.736347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 233/457] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:55 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1510 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:55:55.769624 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6d0dfc2b-9317-4df4-b52e-f70eee4ff8d0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:55.770851 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6d0dfc2b-9317-4df4-b52e-f70eee4ff8d0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:55.778652 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6d0dfc2b-9317-4df4-b52e-f70eee4ff8d0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:55.785322 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6d0dfc2b-9317-4df4-b52e-f70eee4ff8d0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:55.785322 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6d0dfc2b-9317-4df4-b52e-f70eee4ff8d0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:55.785322 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6d0dfc2b-9317-4df4-b52e-f70eee4ff8d0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:55.815911 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6d0dfc2b-9317-4df4-b52e-f70eee4ff8d0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:55:55.860376 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:55:56.741018 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-be0f643f-8f75-45d2-a22b-0108ebf06de8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:56.742250 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-be0f643f-8f75-45d2-a22b-0108ebf06de8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:56.751965 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-be0f643f-8f75-45d2-a22b-0108ebf06de8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:56.762961 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-be0f643f-8f75-45d2-a22b-0108ebf06de8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:56.771599 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-be0f643f-8f75-45d2-a22b-0108ebf06de8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:56.771599 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-be0f643f-8f75-45d2-a22b-0108ebf06de8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:56.820854 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6d0dfc2b-9317-4df4-b52e-f70eee4ff8d0 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "DELETE /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 204 len: 0 microversion: 2.1 time: 1.054949 Jul 15 15:55:56.822122 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 225/458] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 15:55:55 2022] DELETE /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:55:56.840441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-482d0c57-5a39-4852-b330-955d690aa70d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:56.841731 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-482d0c57-5a39-4852-b330-955d690aa70d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:56.860292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-482d0c57-5a39-4852-b330-955d690aa70d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:56.860292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-482d0c57-5a39-4852-b330-955d690aa70d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:56.861192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-482d0c57-5a39-4852-b330-955d690aa70d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:56.861856 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-482d0c57-5a39-4852-b330-955d690aa70d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:57.245140 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-482d0c57-5a39-4852-b330-955d690aa70d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:57.262986 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-482d0c57-5a39-4852-b330-955d690aa70d tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1502 microversion: 2.1 time: 0.435480 Jul 15 15:55:57.278424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 226/459] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:56 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1502 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:57.509663 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-be0f643f-8f75-45d2-a22b-0108ebf06de8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:57.531275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-be0f643f-8f75-45d2-a22b-0108ebf06de8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1516 microversion: 2.1 time: 0.783508 Jul 15 15:55:57.537172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 234/460] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:56 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1516 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:58.294085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-93b60a33-bbf3-4b54-85f8-71c6d573a27b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:55:58.309533 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-93b60a33-bbf3-4b54-85f8-71c6d573a27b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:55:58.327845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-93b60a33-bbf3-4b54-85f8-71c6d573a27b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:58.348761 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-93b60a33-bbf3-4b54-85f8-71c6d573a27b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:58.350894 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-93b60a33-bbf3-4b54-85f8-71c6d573a27b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:55:58.361982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-93b60a33-bbf3-4b54-85f8-71c6d573a27b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:55:59.037667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-93b60a33-bbf3-4b54-85f8-71c6d573a27b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:55:59.052901 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-93b60a33-bbf3-4b54-85f8-71c6d573a27b tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1502 microversion: 2.1 time: 0.774436 Jul 15 15:55:59.058757 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 227/461] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:55:58 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1502 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:55:59.491087 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2a35d975-fc4e-4f32-a863-eb3616f17e42 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: .version_select at 0x7f510aa99f70>, body: {"keypair": {"name": "tempest-keypair-1569657272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNEM0h+TLN5By3hMVwZVAcoM2U2HFSQF96SmSKXfRxVBed2UEVc2vUS6jd/p4OFAPUETN2hC7qwkKvefjmt6Q9bFTcjqrvF6XP3oRnkMwylJtZlyDNM5ivuJiaApZGYyw=="}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:55:59.544079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-2a35d975-fc4e-4f32-a863-eb3616f17e42 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for project c35d3e93d36040bba1bbb873e61d239a. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:55:59.575567 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-2a35d975-fc4e-4f32-a863-eb3616f17e42 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for user 1157b91a306540dd98a072b1ea4941b2 and project c35d3e93d36040bba1bbb873e61d239a. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:55:59.832718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2a35d975-fc4e-4f32-a863-eb3616f17e42 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.596441 Jul 15 15:55:59.833342 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 235/462] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 15:55:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:00.019912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-042af63a-a478-4d5b-aa01-fda3815ad3bd req-ee5d8a77-f316-4ed9-af21-5c229566d842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11221205-c6d9-4968-ab79-bc19b19fa3f7", "name": "network-vif-deleted", "tag": "6b88d5b0-876f-44b7-bdfe-d150297d5251"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:00.038703 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-042af63a-a478-4d5b-aa01-fda3815ad3bd req-ee5d8a77-f316-4ed9-af21-5c229566d842 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:00.042750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-042af63a-a478-4d5b-aa01-fda3815ad3bd req-ee5d8a77-f316-4ed9-af21-5c229566d842 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:00.075681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-042af63a-a478-4d5b-aa01-fda3815ad3bd req-ee5d8a77-f316-4ed9-af21-5c229566d842 service nova] Creating event network-vif-deleted:6b88d5b0-876f-44b7-bdfe-d150297d5251 for instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 on hv-cinder-83587 Jul 15 15:56:00.083518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-62cf103f-da64-4048-89b9-707f29a400dd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:00.089151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-62cf103f-da64-4048-89b9-707f29a400dd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:00.089715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-042af63a-a478-4d5b-aa01-fda3815ad3bd req-ee5d8a77-f316-4ed9-af21-5c229566d842 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069523 Jul 15 15:56:00.089715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 228/463] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:00.095049 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-62cf103f-da64-4048-89b9-707f29a400dd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:00.098127 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-62cf103f-da64-4048-89b9-707f29a400dd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:00.104190 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-62cf103f-da64-4048-89b9-707f29a400dd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:00.104898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-62cf103f-da64-4048-89b9-707f29a400dd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:00.263803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-62cf103f-da64-4048-89b9-707f29a400dd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:00.273288 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-62cf103f-da64-4048-89b9-707f29a400dd tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1460 microversion: 2.1 time: 0.193386 Jul 15 15:56:00.276328 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 236/464] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:00 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1460 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:01.291156 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:01.292546 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:01.305570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:01.306249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:01.307697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:01.308188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:01.339323 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:01.340989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:01.340989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lazy-loading 'fault' on Instance uuid 11221205-c6d9-4968-ab79-bc19b19fa3f7 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:56:01.431516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3efd91d94b44c6aa41087c2f017861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7726f6c7444f16ac5ea9696eacdf57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:01.493679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-024a5078-d4b1-40f4-a4a7-eb092087a837 tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 200 len: 1303 microversion: 2.1 time: 0.205926 Jul 15 15:56:01.523159 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 229/465] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:01 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:02.188384 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c5fd52e8-0989-46d5-8b7c-46457d284d31 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'create', calling method: .version_select at 0x7f510d22f790>, body: {"keypair": {"name": "tempest-keypair-894496137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzryBp2jNDnN1X+ohKuHMJR6fCceMbz0L2MzTVFDpLITI7/j/587FdNsn8l1Tg44jpJGVq8eD1fRaVou11ZoR0iDMwu7kOXW9+rXZ/0POE5eG7vjjYJDN5X62vpddCdIw=="}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:02.221469 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c5fd52e8-0989-46d5-8b7c-46457d284d31 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Getting quotas for project 44cff0ae69e84de486ac2a6866ea6acb. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:56:02.230001 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c5fd52e8-0989-46d5-8b7c-46457d284d31 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Getting quotas for user 9005cb23317a4a05b58e99284824135e and project 44cff0ae69e84de486ac2a6866ea6acb. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:56:02.447032 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c5fd52e8-0989-46d5-8b7c-46457d284d31 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.262406 Jul 15 15:56:02.450108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 237/466] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 15:56:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:02.513049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:02.513714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] [instance: 11221205-c6d9-4968-ab79-bc19b19fa3f7] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:02.526189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:02.526982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:02.528285 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:02.529782 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:02.582071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] HTTP exception thrown: Instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 could not be found. Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Request method failure captured: Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 HTTP/1.1 Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y27nPNxQBbDl8mI4_dSK-ejZt4HKOfKHIDhuOCR9AOgqSUddEts_I9JR5AOLfnF3fwaTTTR6oY9OcicAluGorPj5k1JN5VU3nmrWaZLm2dnd-VAFaFdpuk7SWbmGDYgs4684NspgbvceZ9NfD8YxTmKcSakZO7JogccUvEX7zOIdYE Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 8d7726f6c7444f16ac5ea9696eacdf57 Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-VolumesActionsTest-806726835 Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:56:02.584554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8d7726f6c7444f16ac5ea9696eacdf57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8d7726f6c7444f16ac5ea9696eacdf57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8d7726f6c7444f16ac5ea9696eacdf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8d7726f6c7444f16ac5ea9696eacdf57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-VolumesActionsTest-806726835 Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 8d7726f6c7444f16ac5ea9696eacdf57 Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-VolumesActionsTest-806726835 Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-VolumesActionsTest-806726835-project Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: a3efd91d94b44c6aa41087c2f017861f Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-VolumesActionsTest-806726835-project Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 could not be found. Jul 15 15:56:02.586194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '11221205-c6d9-4968-ab79-bc19b19fa3f7'} Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 could not be found. Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:56:02.587073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 could not be found. Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 could not be found. Jul 15 15:56:02.588954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:56:02.590157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] Returning 404 to user: Instance 11221205-c6d9-4968-ab79-bc19b19fa3f7 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:56:02.590157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e140375a-4d80-4c0d-80a2-2aee36986cdf tempest-VolumesActionsTest-806726835 tempest-VolumesActionsTest-806726835-project] 10.222.0.98 "GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7" status: 404 len: 111 microversion: 2.1 time: 0.079439 Jul 15 15:56:02.590157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 230/467] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:02 2022] GET /compute/v2.1/servers/11221205-c6d9-4968-ab79-bc19b19fa3f7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:56:03.789717 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-735158896", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0ec6ba6-6b6c-449a-8ed1-834796a501b5"}], "security_groups": [{"name": "tempest-securitygroup--805017203"}], "key_name": "tempest-keypair-1569657272", "user_data": "}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:04.037851 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] validate_networks() for [('a0ec6ba6-6b6c-449a-8ed1-834796a501b5', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:56:04.690218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:56:04.691139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:56:04.691649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:56:04.692154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:56:04.692632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:56:04.709508 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:04.710506 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:04.711757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:04.711757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:04.742972 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for project c35d3e93d36040bba1bbb873e61d239a. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:56:04.750270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for user 1157b91a306540dd98a072b1ea4941b2 and project c35d3e93d36040bba1bbb873e61d239a. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:56:04.766533 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:56:04.769685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:56:04.961126 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9963fe96-4cf8-4c45-a0fe-888c06e53524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.179586 Jul 15 15:56:04.967722 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 238/468] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:56:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:56:04.974446 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e2b8e299-a749-47e7-83a9-a11882866a65 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:04.975222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e2b8e299-a749-47e7-83a9-a11882866a65 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:05.554490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e2b8e299-a749-47e7-83a9-a11882866a65 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:05.572313 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e2b8e299-a749-47e7-83a9-a11882866a65 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1241 microversion: 2.1 time: 0.602663 Jul 15 15:56:05.584507 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 231/469] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:04 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1241 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:06.590822 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0287bec5-0230-45a7-8fae-33a9f109f850 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:06.591462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0287bec5-0230-45a7-8fae-33a9f109f850 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:06.644098 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0287bec5-0230-45a7-8fae-33a9f109f850 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:06.651515 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0287bec5-0230-45a7-8fae-33a9f109f850 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1241 microversion: 2.1 time: 0.065372 Jul 15 15:56:06.652086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 239/470] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:06 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:07.120679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-698966363", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6baee11f-f016-413f-b137-fd93cd808df0"}], "security_groups": [{"name": "tempest-securitygroup--1096039176"}], "key_name": "tempest-keypair-894496137", "user_data": "}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:07.238192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] validate_networks() for [('6baee11f-f016-413f-b137-fd93cd808df0', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:56:07.686619 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-db9b296d-882a-4058-839f-21946b0df04d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:07.689710 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-db9b296d-882a-4058-839f-21946b0df04d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:07.706021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db9b296d-882a-4058-839f-21946b0df04d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:07.708126 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db9b296d-882a-4058-839f-21946b0df04d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:07.710701 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db9b296d-882a-4058-839f-21946b0df04d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:07.712227 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db9b296d-882a-4058-839f-21946b0df04d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:07.759434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:56:07.760832 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:56:07.760832 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:56:07.761073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:56:07.761694 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:56:07.772089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:07.772544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:07.773376 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:07.773801 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:07.805437 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Getting quotas for project 44cff0ae69e84de486ac2a6866ea6acb. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:56:07.812888 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Getting quotas for user 9005cb23317a4a05b58e99284824135e and project 44cff0ae69e84de486ac2a6866ea6acb. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:56:07.816996 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-db9b296d-882a-4058-839f-21946b0df04d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:07.826213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-db9b296d-882a-4058-839f-21946b0df04d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1245 microversion: 2.1 time: 0.152832 Jul 15 15:56:07.827105 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:56:07.829599 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 240/471] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:07 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1245 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:07.838682 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:56:08.003975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d124e586-b2ba-4d11-8ad3-27026d8fd54b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.888141 Jul 15 15:56:08.010538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 232/472] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:56:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:56:08.017906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-84b1f988-5c0b-412f-92ab-d28f6dfead56 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:08.019279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-84b1f988-5c0b-412f-92ab-d28f6dfead56 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:08.111620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-84b1f988-5c0b-412f-92ab-d28f6dfead56 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:08.122234 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-84b1f988-5c0b-412f-92ab-d28f6dfead56 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1244 microversion: 2.1 time: 0.110247 Jul 15 15:56:08.132758 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 241/473] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:08 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:08.845673 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-20a69767-0e3f-4885-821f-b256528d39d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:08.846903 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-20a69767-0e3f-4885-821f-b256528d39d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:08.854154 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-20a69767-0e3f-4885-821f-b256528d39d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:08.854933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-20a69767-0e3f-4885-821f-b256528d39d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:08.855926 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-20a69767-0e3f-4885-821f-b256528d39d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:08.856516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-20a69767-0e3f-4885-821f-b256528d39d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:08.945699 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-20a69767-0e3f-4885-821f-b256528d39d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:08.954368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-20a69767-0e3f-4885-821f-b256528d39d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1245 microversion: 2.1 time: 0.112712 Jul 15 15:56:08.955398 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 233/474] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:08 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:09.141950 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dd5f52cb-5085-43ca-b048-102aedae9d70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:09.142734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-dd5f52cb-5085-43ca-b048-102aedae9d70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:09.150679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd5f52cb-5085-43ca-b048-102aedae9d70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:09.151227 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd5f52cb-5085-43ca-b048-102aedae9d70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:09.152039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd5f52cb-5085-43ca-b048-102aedae9d70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:09.152476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd5f52cb-5085-43ca-b048-102aedae9d70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:09.222653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dd5f52cb-5085-43ca-b048-102aedae9d70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:09.231269 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dd5f52cb-5085-43ca-b048-102aedae9d70 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1248 microversion: 2.1 time: 0.093510 Jul 15 15:56:09.239964 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 242/475] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:09 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:09.973030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c112a128-8bd7-4cc7-ac91-d8e55e6e5336 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:09.973657 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c112a128-8bd7-4cc7-ac91-d8e55e6e5336 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:09.980530 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c112a128-8bd7-4cc7-ac91-d8e55e6e5336 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:09.980987 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c112a128-8bd7-4cc7-ac91-d8e55e6e5336 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:09.981765 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c112a128-8bd7-4cc7-ac91-d8e55e6e5336 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:09.982440 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c112a128-8bd7-4cc7-ac91-d8e55e6e5336 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:10.053834 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c112a128-8bd7-4cc7-ac91-d8e55e6e5336 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:10.061844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c112a128-8bd7-4cc7-ac91-d8e55e6e5336 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1245 microversion: 2.1 time: 0.092859 Jul 15 15:56:10.062408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 234/476] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:09 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:10.259119 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cf1cc6da-791b-41dc-977c-c1de5984e635 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:10.260222 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cf1cc6da-791b-41dc-977c-c1de5984e635 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:10.267133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf1cc6da-791b-41dc-977c-c1de5984e635 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:10.267617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf1cc6da-791b-41dc-977c-c1de5984e635 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:10.268387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf1cc6da-791b-41dc-977c-c1de5984e635 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:10.268864 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf1cc6da-791b-41dc-977c-c1de5984e635 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:10.335416 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cf1cc6da-791b-41dc-977c-c1de5984e635 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:10.339810 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:10.344278 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cf1cc6da-791b-41dc-977c-c1de5984e635 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1248 microversion: 2.1 time: 0.089186 Jul 15 15:56:10.344845 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 243/477] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:10 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:11.079163 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-36e2e26f-7075-4806-bbea-2e1648b53856 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:11.080402 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-36e2e26f-7075-4806-bbea-2e1648b53856 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:11.086657 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-36e2e26f-7075-4806-bbea-2e1648b53856 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:11.087111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-36e2e26f-7075-4806-bbea-2e1648b53856 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:11.088192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-36e2e26f-7075-4806-bbea-2e1648b53856 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:11.088632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-36e2e26f-7075-4806-bbea-2e1648b53856 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:11.148173 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-36e2e26f-7075-4806-bbea-2e1648b53856 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:11.155701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-36e2e26f-7075-4806-bbea-2e1648b53856 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1237 microversion: 2.1 time: 0.080669 Jul 15 15:56:11.156265 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 235/478] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:11 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:11.361388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-63043d20-5b7a-4508-b4b8-3318f513b58f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:11.362000 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-63043d20-5b7a-4508-b4b8-3318f513b58f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:11.368579 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-63043d20-5b7a-4508-b4b8-3318f513b58f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:11.369595 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-63043d20-5b7a-4508-b4b8-3318f513b58f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:11.370639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-63043d20-5b7a-4508-b4b8-3318f513b58f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:11.371215 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-63043d20-5b7a-4508-b4b8-3318f513b58f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:11.441900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-63043d20-5b7a-4508-b4b8-3318f513b58f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:11.449702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-63043d20-5b7a-4508-b4b8-3318f513b58f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1240 microversion: 2.1 time: 0.092041 Jul 15 15:56:11.450274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 244/479] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:11 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:11.722084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c4005947-6bff-4f82-98b1-97be5e4f80aa tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Action: 'create', calling method: .version_select at 0x7f510abcc550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-408088148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKz7pqtrLjRyhZFY6nU106qOsRsMk5XpHpEif5qcHvnj3ZsDqnjtWF3Zegg3KVA8yRd19JGEpEnZ3DEA5/DB17cDfBkKJuBrpL1B9OEKEaWdxR0gV7EVTbg63X+q303sQ=="}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:11.741620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-c4005947-6bff-4f82-98b1-97be5e4f80aa tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Getting quotas for project 06d54c4865ff45e59526d477accb6cc4. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:56:11.746393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-c4005947-6bff-4f82-98b1-97be5e4f80aa tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Getting quotas for user bff41a6af0ea495a856fd5603e810d6a and project 06d54c4865ff45e59526d477accb6cc4. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:56:11.861681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c4005947-6bff-4f82-98b1-97be5e4f80aa tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.131838 Jul 15 15:56:11.861681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 236/480] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 15:56:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:56:11.957913 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-453037586", "imageRef": "125d1e01-d773-4ccd-a6b0-c357141bc769", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-408088148", "networks": [{"uuid": "b632043a-4278-4e22-a8ab-19fd92244ccb"}]}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:12.009741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] validate_networks() for [('b632043a-4278-4e22-a8ab-19fd92244ccb', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:56:12.192844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e5698036-aeee-4169-a0a0-ebe396be461d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:12.197882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e5698036-aeee-4169-a0a0-ebe396be461d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:12.220683 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e5698036-aeee-4169-a0a0-ebe396be461d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:12.224026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e5698036-aeee-4169-a0a0-ebe396be461d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:12.226315 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e5698036-aeee-4169-a0a0-ebe396be461d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:12.227898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e5698036-aeee-4169-a0a0-ebe396be461d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:12.509148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e5698036-aeee-4169-a0a0-ebe396be461d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:12.523611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e5698036-aeee-4169-a0a0-ebe396be461d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1301 microversion: 2.1 time: 0.353978 Jul 15 15:56:12.534268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 237/481] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:12 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1301 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:12.539513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4e91a49d-0662-4078-8255-c753dea1e629 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:12.540357 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4e91a49d-0662-4078-8255-c753dea1e629 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:12.547686 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e91a49d-0662-4078-8255-c753dea1e629 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:12.553178 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e91a49d-0662-4078-8255-c753dea1e629 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:12.554252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e91a49d-0662-4078-8255-c753dea1e629 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:12.556031 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e91a49d-0662-4078-8255-c753dea1e629 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:12.589988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:56:12.590927 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:56:12.591765 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:56:12.592327 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:56:12.592893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:56:12.611806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:12.614626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:12.614626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:12.614626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:12.640003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Getting quotas for project 06d54c4865ff45e59526d477accb6cc4. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:56:12.660971 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4e91a49d-0662-4078-8255-c753dea1e629 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:12.661119 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Getting quotas for user bff41a6af0ea495a856fd5603e810d6a and project 06d54c4865ff45e59526d477accb6cc4. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:56:12.674025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4e91a49d-0662-4078-8255-c753dea1e629 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1296 microversion: 2.1 time: 0.138298 Jul 15 15:56:12.674620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 238/482] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:12 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1296 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:12.722188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:56:12.731310 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='125d1e01-d773-4ccd-a6b0-c357141bc769',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:56:12.800047 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:12.957964 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ee616c26-08f9-4592-b161-02393ab72293 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006332 Jul 15 15:56:12.970097 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8df65321-d6f1-45bc-a1b8-6f7929524f09 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:12.970971 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8df65321-d6f1-45bc-a1b8-6f7929524f09 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:12.975648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 245/483] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:56:13.132687 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8df65321-d6f1-45bc-a1b8-6f7929524f09 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:13.146551 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8df65321-d6f1-45bc-a1b8-6f7929524f09 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1257 microversion: 2.1 time: 0.177972 Jul 15 15:56:13.149927 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 239/484] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:12 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1257 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:13.543441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-65a32682-abb7-48db-88a3-bc5117fb3305 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:13.544234 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-65a32682-abb7-48db-88a3-bc5117fb3305 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:13.561605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-65a32682-abb7-48db-88a3-bc5117fb3305 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:13.565707 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-65a32682-abb7-48db-88a3-bc5117fb3305 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:13.566719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-65a32682-abb7-48db-88a3-bc5117fb3305 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:13.567339 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-65a32682-abb7-48db-88a3-bc5117fb3305 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:13.694153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-729f8ea6-8e14-4da4-a02e-2fb13a49ce42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:13.695529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-729f8ea6-8e14-4da4-a02e-2fb13a49ce42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:13.700893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-65a32682-abb7-48db-88a3-bc5117fb3305 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:13.711124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-729f8ea6-8e14-4da4-a02e-2fb13a49ce42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:13.713512 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-729f8ea6-8e14-4da4-a02e-2fb13a49ce42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:13.720026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-729f8ea6-8e14-4da4-a02e-2fb13a49ce42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:13.722150 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-729f8ea6-8e14-4da4-a02e-2fb13a49ce42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:13.733902 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-65a32682-abb7-48db-88a3-bc5117fb3305 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1299 microversion: 2.1 time: 0.196571 Jul 15 15:56:13.743412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 246/485] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:13 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:13.951519 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-729f8ea6-8e14-4da4-a02e-2fb13a49ce42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:13.995665 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-729f8ea6-8e14-4da4-a02e-2fb13a49ce42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1302 microversion: 2.1 time: 0.300519 Jul 15 15:56:14.016552 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 240/486] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:13 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1302 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:14.166159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7fca3117-9ba9-4675-9f89-359e6bd09484 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:14.166783 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7fca3117-9ba9-4675-9f89-359e6bd09484 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:14.268046 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7fca3117-9ba9-4675-9f89-359e6bd09484 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:14.282616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7fca3117-9ba9-4675-9f89-359e6bd09484 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1257 microversion: 2.1 time: 0.122374 Jul 15 15:56:14.286405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 247/487] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:14 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1257 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:14.758203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a116589f-7516-41ba-9b65-b119ea8b55bf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:14.760085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a116589f-7516-41ba-9b65-b119ea8b55bf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:14.776205 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a116589f-7516-41ba-9b65-b119ea8b55bf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:14.776722 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a116589f-7516-41ba-9b65-b119ea8b55bf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:14.803501 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a116589f-7516-41ba-9b65-b119ea8b55bf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:14.808187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a116589f-7516-41ba-9b65-b119ea8b55bf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:15.016204 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-695139a1-9454-4a9c-a535-dcbf0dfbad80 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:15.017468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-695139a1-9454-4a9c-a535-dcbf0dfbad80 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:15.025918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-695139a1-9454-4a9c-a535-dcbf0dfbad80 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:15.038349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-695139a1-9454-4a9c-a535-dcbf0dfbad80 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:15.038875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-695139a1-9454-4a9c-a535-dcbf0dfbad80 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:15.039382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-695139a1-9454-4a9c-a535-dcbf0dfbad80 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:15.522756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a116589f-7516-41ba-9b65-b119ea8b55bf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:15.538993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a116589f-7516-41ba-9b65-b119ea8b55bf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.785665 Jul 15 15:56:15.541500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 241/488] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:14 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:15.552114 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8124cd91-e58f-4b10-ab39-5aa625fcb287 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:15.552740 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8124cd91-e58f-4b10-ab39-5aa625fcb287 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:15.562449 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8124cd91-e58f-4b10-ab39-5aa625fcb287 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:15.563218 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8124cd91-e58f-4b10-ab39-5aa625fcb287 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:15.569729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8124cd91-e58f-4b10-ab39-5aa625fcb287 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:15.569729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8124cd91-e58f-4b10-ab39-5aa625fcb287 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:15.591115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-695139a1-9454-4a9c-a535-dcbf0dfbad80 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:15.605353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-695139a1-9454-4a9c-a535-dcbf0dfbad80 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.592767 Jul 15 15:56:15.616482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 248/489] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:15 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:15.640786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8124cd91-e58f-4b10-ab39-5aa625fcb287 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:15.674411 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8124cd91-e58f-4b10-ab39-5aa625fcb287 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1253 microversion: 2.1 time: 0.131157 Jul 15 15:56:15.674625 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 242/490] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:15 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1253 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:15.712749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-1a461a4b-aafd-40eb-b349-d0ce2f07eca5 req-c8af8994-20a3-4cc4-8bb6-76924cd600c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ed846f-5dcd-4d82-9aef-bd786bf6a6cf", "tag": "15a05a60-9557-46ed-a4b2-d512781fa87a"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:15.729766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-1a461a4b-aafd-40eb-b349-d0ce2f07eca5 req-c8af8994-20a3-4cc4-8bb6-76924cd600c9 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:15.732343 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-1a461a4b-aafd-40eb-b349-d0ce2f07eca5 req-c8af8994-20a3-4cc4-8bb6-76924cd600c9 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:15.757987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-1a461a4b-aafd-40eb-b349-d0ce2f07eca5 req-c8af8994-20a3-4cc4-8bb6-76924cd600c9 service nova] Creating event network-changed:15a05a60-9557-46ed-a4b2-d512781fa87a for instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf on hv-cinder-83587 Jul 15 15:56:15.765173 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-1a461a4b-aafd-40eb-b349-d0ce2f07eca5 req-c8af8994-20a3-4cc4-8bb6-76924cd600c9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064326 Jul 15 15:56:15.766598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 249/491] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:15.866193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-25cc060f-5a9b-4861-a836-d31ad30270c6 req-7a89b878-4182-43b2-804d-ebf454690044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d049f0c3-2447-4627-b276-74454c4f13fe", "tag": "e504616b-d5ea-4a8d-89f2-7ea9f3df5838"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:15.889980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-25cc060f-5a9b-4861-a836-d31ad30270c6 req-7a89b878-4182-43b2-804d-ebf454690044 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:15.891452 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-25cc060f-5a9b-4861-a836-d31ad30270c6 req-7a89b878-4182-43b2-804d-ebf454690044 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:15.924448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-25cc060f-5a9b-4861-a836-d31ad30270c6 req-7a89b878-4182-43b2-804d-ebf454690044 service nova] Creating event network-changed:e504616b-d5ea-4a8d-89f2-7ea9f3df5838 for instance d049f0c3-2447-4627-b276-74454c4f13fe on hv-cinder-83587 Jul 15 15:56:15.938350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-25cc060f-5a9b-4861-a836-d31ad30270c6 req-7a89b878-4182-43b2-804d-ebf454690044 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073664 Jul 15 15:56:15.940048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 243/492] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:16.556958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1ab73b20-1d13-439f-ac01-a97ee624d9cd tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:16.558688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1ab73b20-1d13-439f-ac01-a97ee624d9cd tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:16.598388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1ab73b20-1d13-439f-ac01-a97ee624d9cd tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:16.598388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1ab73b20-1d13-439f-ac01-a97ee624d9cd tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:16.598388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1ab73b20-1d13-439f-ac01-a97ee624d9cd tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:16.598388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1ab73b20-1d13-439f-ac01-a97ee624d9cd tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:16.640715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-75404216-7a53-44da-8d91-45915e9abc20 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:16.641841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-75404216-7a53-44da-8d91-45915e9abc20 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:16.677566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75404216-7a53-44da-8d91-45915e9abc20 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:16.683618 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75404216-7a53-44da-8d91-45915e9abc20 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:16.683618 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75404216-7a53-44da-8d91-45915e9abc20 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:16.683618 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75404216-7a53-44da-8d91-45915e9abc20 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:16.984709 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1ab73b20-1d13-439f-ac01-a97ee624d9cd tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:16.998779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1ab73b20-1d13-439f-ac01-a97ee624d9cd tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.445686 Jul 15 15:56:16.999687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 250/493] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:16 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:17.004918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-11c22d37-5b56-4e4c-8d17-baca27fe34b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:17.005761 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-11c22d37-5b56-4e4c-8d17-baca27fe34b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:17.010914 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-75404216-7a53-44da-8d91-45915e9abc20 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:17.014607 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11c22d37-5b56-4e4c-8d17-baca27fe34b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:17.015249 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11c22d37-5b56-4e4c-8d17-baca27fe34b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:17.016809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11c22d37-5b56-4e4c-8d17-baca27fe34b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:17.017438 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11c22d37-5b56-4e4c-8d17-baca27fe34b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:17.022656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-75404216-7a53-44da-8d91-45915e9abc20 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.393440 Jul 15 15:56:17.050623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 244/494] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:16 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:17.158797 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-11c22d37-5b56-4e4c-8d17-baca27fe34b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:17.178666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-11c22d37-5b56-4e4c-8d17-baca27fe34b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1317 microversion: 2.1 time: 0.171382 Jul 15 15:56:17.182682 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 251/495] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:16 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:18.016600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-cae56c45-d0ab-49bf-a227-8f622630c051 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:18.017220 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-cae56c45-d0ab-49bf-a227-8f622630c051 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:18.019443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:18.020501 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:18.047872 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-411dfd17-9de1-4c7b-b562-da73e828a202 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:18.048484 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-411dfd17-9de1-4c7b-b562-da73e828a202 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:18.062454 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-411dfd17-9de1-4c7b-b562-da73e828a202 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:18.068211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-411dfd17-9de1-4c7b-b562-da73e828a202 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:18.068981 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cae56c45-d0ab-49bf-a227-8f622630c051 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:18.072160 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-411dfd17-9de1-4c7b-b562-da73e828a202 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:18.075115 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cae56c45-d0ab-49bf-a227-8f622630c051 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:18.076195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-411dfd17-9de1-4c7b-b562-da73e828a202 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:18.080249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cae56c45-d0ab-49bf-a227-8f622630c051 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:18.096316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cae56c45-d0ab-49bf-a227-8f622630c051 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:18.408570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-cae56c45-d0ab-49bf-a227-8f622630c051 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:18.421366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-cae56c45-d0ab-49bf-a227-8f622630c051 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.408941 Jul 15 15:56:18.422194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 245/496] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:18 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:18.426696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-94ac416f-14be-42d7-b87d-289960c68701 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:18.432930 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-94ac416f-14be-42d7-b87d-289960c68701 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:18.449317 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-411dfd17-9de1-4c7b-b562-da73e828a202 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:18.455631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-94ac416f-14be-42d7-b87d-289960c68701 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:18.455631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-94ac416f-14be-42d7-b87d-289960c68701 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:18.455631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-94ac416f-14be-42d7-b87d-289960c68701 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:18.455631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-94ac416f-14be-42d7-b87d-289960c68701 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:18.456901 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-411dfd17-9de1-4c7b-b562-da73e828a202 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.413946 Jul 15 15:56:18.457504 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 252/497] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:18 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:18.545583 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-94ac416f-14be-42d7-b87d-289960c68701 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:18.549613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:18.555718 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-94ac416f-14be-42d7-b87d-289960c68701 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1315 microversion: 2.1 time: 0.132178 Jul 15 15:56:18.557047 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 246/498] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:18 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1315 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:19.438342 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8fcf2618-7f5d-4bb6-a601-66e7ea2ef997 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:19.438968 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8fcf2618-7f5d-4bb6-a601-66e7ea2ef997 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:19.449461 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8fcf2618-7f5d-4bb6-a601-66e7ea2ef997 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:19.452297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8fcf2618-7f5d-4bb6-a601-66e7ea2ef997 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:19.453316 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8fcf2618-7f5d-4bb6-a601-66e7ea2ef997 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:19.455858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8fcf2618-7f5d-4bb6-a601-66e7ea2ef997 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:19.474344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dd8605b7-63dd-4924-a22c-da9bfb391440 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:19.478205 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dd8605b7-63dd-4924-a22c-da9bfb391440 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:19.484623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd8605b7-63dd-4924-a22c-da9bfb391440 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:19.488581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd8605b7-63dd-4924-a22c-da9bfb391440 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:19.489647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd8605b7-63dd-4924-a22c-da9bfb391440 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:19.491509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd8605b7-63dd-4924-a22c-da9bfb391440 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:19.654514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8fcf2618-7f5d-4bb6-a601-66e7ea2ef997 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:19.670311 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8fcf2618-7f5d-4bb6-a601-66e7ea2ef997 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.235766 Jul 15 15:56:19.680816 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 253/499] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:19 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:19.685810 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-efc5fb20-b49c-4cf4-a7e2-a4a808db7049 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:19.687022 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-efc5fb20-b49c-4cf4-a7e2-a4a808db7049 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:19.705274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efc5fb20-b49c-4cf4-a7e2-a4a808db7049 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:19.708133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efc5fb20-b49c-4cf4-a7e2-a4a808db7049 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:19.708133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efc5fb20-b49c-4cf4-a7e2-a4a808db7049 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:19.708133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efc5fb20-b49c-4cf4-a7e2-a4a808db7049 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:19.710506 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-dd8605b7-63dd-4924-a22c-da9bfb391440 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:19.723860 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dd8605b7-63dd-4924-a22c-da9bfb391440 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.253671 Jul 15 15:56:19.725123 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 247/500] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:19 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:19.901550 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-efc5fb20-b49c-4cf4-a7e2-a4a808db7049 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:19.924286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-efc5fb20-b49c-4cf4-a7e2-a4a808db7049 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.250572 Jul 15 15:56:19.925174 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 254/501] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:19 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:20.697494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9090dfd1-7876-43e7-980d-a8382f65e733 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:20.697494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9090dfd1-7876-43e7-980d-a8382f65e733 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:20.718646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9090dfd1-7876-43e7-980d-a8382f65e733 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:20.718646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9090dfd1-7876-43e7-980d-a8382f65e733 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:20.718646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9090dfd1-7876-43e7-980d-a8382f65e733 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:20.718646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9090dfd1-7876-43e7-980d-a8382f65e733 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:20.744003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3cbd32f5-7202-4998-9e2f-f8875a11dcc6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:20.748208 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3cbd32f5-7202-4998-9e2f-f8875a11dcc6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:20.765684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3cbd32f5-7202-4998-9e2f-f8875a11dcc6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:20.766161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3cbd32f5-7202-4998-9e2f-f8875a11dcc6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:20.766976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3cbd32f5-7202-4998-9e2f-f8875a11dcc6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:20.775605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3cbd32f5-7202-4998-9e2f-f8875a11dcc6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:21.004548 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3cbd32f5-7202-4998-9e2f-f8875a11dcc6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:21.020518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3cbd32f5-7202-4998-9e2f-f8875a11dcc6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.279798 Jul 15 15:56:21.026027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9090dfd1-7876-43e7-980d-a8382f65e733 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:21.031748 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 255/502] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:20 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:21.037217 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bd6edd5f-b70e-4c06-9988-5a08407aa2ef tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:21.060889 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bd6edd5f-b70e-4c06-9988-5a08407aa2ef tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:21.061610 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9090dfd1-7876-43e7-980d-a8382f65e733 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.358506 Jul 15 15:56:21.061610 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 248/503] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:20 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:21.062157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd6edd5f-b70e-4c06-9988-5a08407aa2ef tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:21.062157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd6edd5f-b70e-4c06-9988-5a08407aa2ef tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:21.062157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd6edd5f-b70e-4c06-9988-5a08407aa2ef tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:21.062157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd6edd5f-b70e-4c06-9988-5a08407aa2ef tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:21.251277 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bd6edd5f-b70e-4c06-9988-5a08407aa2ef tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:21.269766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bd6edd5f-b70e-4c06-9988-5a08407aa2ef tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.233192 Jul 15 15:56:21.269766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 256/504] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:21 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:22.039087 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-109a7dff-a516-462c-bf95-46755c932f17 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:22.039906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-109a7dff-a516-462c-bf95-46755c932f17 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:22.063984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-109a7dff-a516-462c-bf95-46755c932f17 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:22.066411 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-109a7dff-a516-462c-bf95-46755c932f17 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:22.067516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-109a7dff-a516-462c-bf95-46755c932f17 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:22.070276 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-109a7dff-a516-462c-bf95-46755c932f17 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:22.072425 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d404d2d8-61e0-4ccf-8bdd-85bd03a91198 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:22.073118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d404d2d8-61e0-4ccf-8bdd-85bd03a91198 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:22.097148 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d404d2d8-61e0-4ccf-8bdd-85bd03a91198 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:22.104099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d404d2d8-61e0-4ccf-8bdd-85bd03a91198 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:22.105544 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d404d2d8-61e0-4ccf-8bdd-85bd03a91198 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:22.107881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d404d2d8-61e0-4ccf-8bdd-85bd03a91198 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:22.402491 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-109a7dff-a516-462c-bf95-46755c932f17 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:22.441015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-109a7dff-a516-462c-bf95-46755c932f17 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.386297 Jul 15 15:56:22.441015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 249/505] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:22 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:22.441015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-00fd11e3-1af8-47d5-9ce5-c0efaeade7fb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:22.441015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-00fd11e3-1af8-47d5-9ce5-c0efaeade7fb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:22.443160 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-00fd11e3-1af8-47d5-9ce5-c0efaeade7fb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:22.443838 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-00fd11e3-1af8-47d5-9ce5-c0efaeade7fb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:22.444781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-00fd11e3-1af8-47d5-9ce5-c0efaeade7fb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:22.445370 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-00fd11e3-1af8-47d5-9ce5-c0efaeade7fb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:22.450061 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d404d2d8-61e0-4ccf-8bdd-85bd03a91198 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:22.459492 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d404d2d8-61e0-4ccf-8bdd-85bd03a91198 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.393385 Jul 15 15:56:22.461077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 257/506] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:22 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:22.780409 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-00fd11e3-1af8-47d5-9ce5-c0efaeade7fb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:22.789281 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-00fd11e3-1af8-47d5-9ce5-c0efaeade7fb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.357115 Jul 15 15:56:22.800209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 250/507] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:22 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:23.435560 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=4 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:23.453576 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-aeef6447-5ef4-4b7b-851a-1f35f3ab8e07 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:23.486598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-aeef6447-5ef4-4b7b-851a-1f35f3ab8e07 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:23.486598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-aeef6447-5ef4-4b7b-851a-1f35f3ab8e07 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:23.486598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-aeef6447-5ef4-4b7b-851a-1f35f3ab8e07 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:23.486598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-aeef6447-5ef4-4b7b-851a-1f35f3ab8e07 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:23.487021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-aeef6447-5ef4-4b7b-851a-1f35f3ab8e07 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:23.487121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f5c09d0b-0be2-4c21-8162-ea98a1f9b297 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:23.487121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f5c09d0b-0be2-4c21-8162-ea98a1f9b297 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:23.488141 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=14 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:23.491189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5c09d0b-0be2-4c21-8162-ea98a1f9b297 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:23.492014 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5c09d0b-0be2-4c21-8162-ea98a1f9b297 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:23.493289 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5c09d0b-0be2-4c21-8162-ea98a1f9b297 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:23.494120 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5c09d0b-0be2-4c21-8162-ea98a1f9b297 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:23.747214 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f5c09d0b-0be2-4c21-8162-ea98a1f9b297 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:23.755617 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f5c09d0b-0be2-4c21-8162-ea98a1f9b297 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.280555 Jul 15 15:56:23.758120 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 251/508] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:23 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:23.785989 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-aeef6447-5ef4-4b7b-851a-1f35f3ab8e07 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:23.794183 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-aeef6447-5ef4-4b7b-851a-1f35f3ab8e07 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.359413 Jul 15 15:56:23.794860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 258/509] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:23 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:23.808326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-aa25508c-6abb-40fe-8eb5-47b4df44d84c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:23.809029 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-aa25508c-6abb-40fe-8eb5-47b4df44d84c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:23.821838 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa25508c-6abb-40fe-8eb5-47b4df44d84c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:23.822784 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa25508c-6abb-40fe-8eb5-47b4df44d84c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:23.823835 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa25508c-6abb-40fe-8eb5-47b4df44d84c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:23.824486 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa25508c-6abb-40fe-8eb5-47b4df44d84c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:24.170188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-aa25508c-6abb-40fe-8eb5-47b4df44d84c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:24.183062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-aa25508c-6abb-40fe-8eb5-47b4df44d84c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.377956 Jul 15 15:56:24.184692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 252/510] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:23 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:24.775817 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-67682879-e2c5-4783-a89f-9de4fa7db435 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:24.776406 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-67682879-e2c5-4783-a89f-9de4fa7db435 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:24.778823 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=26 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:24.785082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67682879-e2c5-4783-a89f-9de4fa7db435 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:24.812592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67682879-e2c5-4783-a89f-9de4fa7db435 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:24.815001 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-58d79f77-3edc-4377-91f0-4344d8c6142e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:24.816736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-58d79f77-3edc-4377-91f0-4344d8c6142e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:24.818085 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67682879-e2c5-4783-a89f-9de4fa7db435 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:24.819902 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67682879-e2c5-4783-a89f-9de4fa7db435 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:24.840925 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-58d79f77-3edc-4377-91f0-4344d8c6142e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:24.841382 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-58d79f77-3edc-4377-91f0-4344d8c6142e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:24.842184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-58d79f77-3edc-4377-91f0-4344d8c6142e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:24.842627 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-58d79f77-3edc-4377-91f0-4344d8c6142e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:25.107557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-67682879-e2c5-4783-a89f-9de4fa7db435 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:25.115815 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-58d79f77-3edc-4377-91f0-4344d8c6142e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:25.116240 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-67682879-e2c5-4783-a89f-9de4fa7db435 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.344771 Jul 15 15:56:25.118436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 259/511] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:24 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:25.128948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-58d79f77-3edc-4377-91f0-4344d8c6142e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.318097 Jul 15 15:56:25.129544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 253/512] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:24 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:25.207115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a5d2b7e4-5be5-485b-b9e8-77857a1c2cc2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:25.207115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a5d2b7e4-5be5-485b-b9e8-77857a1c2cc2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:25.226835 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a5d2b7e4-5be5-485b-b9e8-77857a1c2cc2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:25.229136 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a5d2b7e4-5be5-485b-b9e8-77857a1c2cc2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:25.230657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a5d2b7e4-5be5-485b-b9e8-77857a1c2cc2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:25.232533 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a5d2b7e4-5be5-485b-b9e8-77857a1c2cc2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:25.538927 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a5d2b7e4-5be5-485b-b9e8-77857a1c2cc2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:25.552539 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a5d2b7e4-5be5-485b-b9e8-77857a1c2cc2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.351394 Jul 15 15:56:25.563278 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 260/513] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:25 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:25.655910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-37549b97-fa02-443c-afb2-2d55e21ce671 req-95af3740-021e-41d3-a531-da6486ab7bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ed846f-5dcd-4d82-9aef-bd786bf6a6cf", "name": "network-vif-plugged", "status": "completed", "tag": "15a05a60-9557-46ed-a4b2-d512781fa87a"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:25.668057 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-37549b97-fa02-443c-afb2-2d55e21ce671 req-95af3740-021e-41d3-a531-da6486ab7bb6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:25.670422 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-37549b97-fa02-443c-afb2-2d55e21ce671 req-95af3740-021e-41d3-a531-da6486ab7bb6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:25.689743 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-37549b97-fa02-443c-afb2-2d55e21ce671 req-95af3740-021e-41d3-a531-da6486ab7bb6 service nova] Creating event network-vif-plugged:15a05a60-9557-46ed-a4b2-d512781fa87a for instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf on hv-cinder-83587 Jul 15 15:56:25.697216 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-37549b97-fa02-443c-afb2-2d55e21ce671 req-95af3740-021e-41d3-a531-da6486ab7bb6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044383 Jul 15 15:56:25.698067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 254/514] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:26.136464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9d00ea99-daea-4332-8352-83d82240a6f3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:26.137245 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9d00ea99-daea-4332-8352-83d82240a6f3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:26.146716 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-224d5c10-1b8f-4233-b6c2-e547a7f51d5c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:26.148219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-224d5c10-1b8f-4233-b6c2-e547a7f51d5c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:26.153198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9d00ea99-daea-4332-8352-83d82240a6f3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:26.153666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9d00ea99-daea-4332-8352-83d82240a6f3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:26.154488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9d00ea99-daea-4332-8352-83d82240a6f3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:26.154933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9d00ea99-daea-4332-8352-83d82240a6f3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:26.160959 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-224d5c10-1b8f-4233-b6c2-e547a7f51d5c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:26.161973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-224d5c10-1b8f-4233-b6c2-e547a7f51d5c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:26.163030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-224d5c10-1b8f-4233-b6c2-e547a7f51d5c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:26.164266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-224d5c10-1b8f-4233-b6c2-e547a7f51d5c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:26.438211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9d00ea99-daea-4332-8352-83d82240a6f3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:26.450014 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9d00ea99-daea-4332-8352-83d82240a6f3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.316978 Jul 15 15:56:26.460723 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 261/515] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:26 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:26.483360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-224d5c10-1b8f-4233-b6c2-e547a7f51d5c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:26.494141 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-224d5c10-1b8f-4233-b6c2-e547a7f51d5c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.351381 Jul 15 15:56:26.504723 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 255/516] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:26 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:26.573102 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ae76d6fc-f61f-4583-9fea-c6d4655d6258 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:26.573867 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ae76d6fc-f61f-4583-9fea-c6d4655d6258 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:26.584800 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae76d6fc-f61f-4583-9fea-c6d4655d6258 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:26.589344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae76d6fc-f61f-4583-9fea-c6d4655d6258 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:26.589344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae76d6fc-f61f-4583-9fea-c6d4655d6258 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:26.589344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae76d6fc-f61f-4583-9fea-c6d4655d6258 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:26.831697 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ae76d6fc-f61f-4583-9fea-c6d4655d6258 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:26.835387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:26.840526 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ae76d6fc-f61f-4583-9fea-c6d4655d6258 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.274108 Jul 15 15:56:26.850421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 262/517] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:26 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:27.469535 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-de9b64d3-d68c-44d0-b40b-3e111aae4986 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:27.470515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-de9b64d3-d68c-44d0-b40b-3e111aae4986 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:27.479496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de9b64d3-d68c-44d0-b40b-3e111aae4986 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:27.480031 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de9b64d3-d68c-44d0-b40b-3e111aae4986 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:27.481133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de9b64d3-d68c-44d0-b40b-3e111aae4986 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:27.481603 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de9b64d3-d68c-44d0-b40b-3e111aae4986 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:27.517714 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-59968947-b1f3-4867-ac60-4013befcdfb4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:27.519089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-59968947-b1f3-4867-ac60-4013befcdfb4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:27.530862 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-59968947-b1f3-4867-ac60-4013befcdfb4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:27.534831 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-59968947-b1f3-4867-ac60-4013befcdfb4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:27.536070 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-59968947-b1f3-4867-ac60-4013befcdfb4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:27.536744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-59968947-b1f3-4867-ac60-4013befcdfb4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:27.652384 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-de9b64d3-d68c-44d0-b40b-3e111aae4986 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:27.662266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-de9b64d3-d68c-44d0-b40b-3e111aae4986 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.199678 Jul 15 15:56:27.665658 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 256/518] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:27 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:27.791466 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-59968947-b1f3-4867-ac60-4013befcdfb4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:27.803813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-59968947-b1f3-4867-ac60-4013befcdfb4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.296368 Jul 15 15:56:27.804718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 263/519] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:27 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:27.857937 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-33399247-a76c-4153-ab93-1621b7691a44 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:27.858556 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-33399247-a76c-4153-ab93-1621b7691a44 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:27.865953 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-33399247-a76c-4153-ab93-1621b7691a44 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:27.866788 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-33399247-a76c-4153-ab93-1621b7691a44 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:27.868402 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-33399247-a76c-4153-ab93-1621b7691a44 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:27.869147 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-33399247-a76c-4153-ab93-1621b7691a44 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:28.069560 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-33399247-a76c-4153-ab93-1621b7691a44 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:28.083750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-33399247-a76c-4153-ab93-1621b7691a44 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.229475 Jul 15 15:56:28.096711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 257/520] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:27 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:28.689937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f41a238d-81bf-4446-a70e-0558af90b0d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:28.691657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f41a238d-81bf-4446-a70e-0558af90b0d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:28.699253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f41a238d-81bf-4446-a70e-0558af90b0d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:28.699741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f41a238d-81bf-4446-a70e-0558af90b0d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:28.700570 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f41a238d-81bf-4446-a70e-0558af90b0d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:28.701284 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f41a238d-81bf-4446-a70e-0558af90b0d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:28.821711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2271e6e6-a610-4414-8674-9e6e3620a3d4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:28.822365 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2271e6e6-a610-4414-8674-9e6e3620a3d4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:28.840281 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2271e6e6-a610-4414-8674-9e6e3620a3d4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:28.841967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2271e6e6-a610-4414-8674-9e6e3620a3d4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:28.841967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2271e6e6-a610-4414-8674-9e6e3620a3d4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:28.848831 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2271e6e6-a610-4414-8674-9e6e3620a3d4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:28.907916 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f41a238d-81bf-4446-a70e-0558af90b0d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:28.929478 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f41a238d-81bf-4446-a70e-0558af90b0d0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.250776 Jul 15 15:56:28.930085 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 264/521] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:28 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:29.119887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d612b204-7a90-41e0-914a-e3ab0e1d19bd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:29.119887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d612b204-7a90-41e0-914a-e3ab0e1d19bd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:29.135860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d612b204-7a90-41e0-914a-e3ab0e1d19bd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:29.135860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d612b204-7a90-41e0-914a-e3ab0e1d19bd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:29.135860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d612b204-7a90-41e0-914a-e3ab0e1d19bd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:29.135860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d612b204-7a90-41e0-914a-e3ab0e1d19bd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:29.296813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2271e6e6-a610-4414-8674-9e6e3620a3d4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:29.304645 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2271e6e6-a610-4414-8674-9e6e3620a3d4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.486680 Jul 15 15:56:29.305249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 258/522] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:28 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:29.315101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d612b204-7a90-41e0-914a-e3ab0e1d19bd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:29.324177 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d612b204-7a90-41e0-914a-e3ab0e1d19bd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.211952 Jul 15 15:56:29.325087 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 265/523] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:29 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:29.946868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-268465c3-9554-452a-a0f2-dfd570386ab1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:29.947797 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-268465c3-9554-452a-a0f2-dfd570386ab1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:29.960209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-268465c3-9554-452a-a0f2-dfd570386ab1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:29.961736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-268465c3-9554-452a-a0f2-dfd570386ab1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:29.963199 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-268465c3-9554-452a-a0f2-dfd570386ab1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:29.963881 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-268465c3-9554-452a-a0f2-dfd570386ab1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:30.169309 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-268465c3-9554-452a-a0f2-dfd570386ab1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:30.180784 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-268465c3-9554-452a-a0f2-dfd570386ab1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.238653 Jul 15 15:56:30.182145 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 259/524] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:29 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:30.322437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1a5cd0ec-91e8-4b8f-9e95-e4f34b1ba291 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:30.323758 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1a5cd0ec-91e8-4b8f-9e95-e4f34b1ba291 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:30.333742 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1a5cd0ec-91e8-4b8f-9e95-e4f34b1ba291 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:30.344138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1a5cd0ec-91e8-4b8f-9e95-e4f34b1ba291 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:30.344138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1a5cd0ec-91e8-4b8f-9e95-e4f34b1ba291 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:30.344138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1a5cd0ec-91e8-4b8f-9e95-e4f34b1ba291 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:30.345132 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9cc54f56-1ccf-4970-b5e2-8e074d38e0de tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:30.345937 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9cc54f56-1ccf-4970-b5e2-8e074d38e0de tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:30.355627 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cc54f56-1ccf-4970-b5e2-8e074d38e0de tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:30.358666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cc54f56-1ccf-4970-b5e2-8e074d38e0de tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:30.359754 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cc54f56-1ccf-4970-b5e2-8e074d38e0de tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:30.360404 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cc54f56-1ccf-4970-b5e2-8e074d38e0de tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:30.541867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9cc54f56-1ccf-4970-b5e2-8e074d38e0de tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:30.550146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9cc54f56-1ccf-4970-b5e2-8e074d38e0de tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.209587 Jul 15 15:56:30.550867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 260/525] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:30 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:30.618198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1a5cd0ec-91e8-4b8f-9e95-e4f34b1ba291 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:30.626565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1a5cd0ec-91e8-4b8f-9e95-e4f34b1ba291 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.309058 Jul 15 15:56:30.627824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 266/526] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:30 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:31.256094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1f652fe1-4006-4b6c-8e39-3fb5d6be7d93 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:31.256796 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1f652fe1-4006-4b6c-8e39-3fb5d6be7d93 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:31.269584 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f652fe1-4006-4b6c-8e39-3fb5d6be7d93 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:31.270547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f652fe1-4006-4b6c-8e39-3fb5d6be7d93 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:31.283471 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f652fe1-4006-4b6c-8e39-3fb5d6be7d93 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:31.284429 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f652fe1-4006-4b6c-8e39-3fb5d6be7d93 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:31.575024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-20ee8fda-cc0b-416d-9803-5fc1d65ea4dd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:31.575746 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-20ee8fda-cc0b-416d-9803-5fc1d65ea4dd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:31.588309 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20ee8fda-cc0b-416d-9803-5fc1d65ea4dd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:31.588852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20ee8fda-cc0b-416d-9803-5fc1d65ea4dd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:31.590811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20ee8fda-cc0b-416d-9803-5fc1d65ea4dd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:31.599894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20ee8fda-cc0b-416d-9803-5fc1d65ea4dd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:31.629443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1f652fe1-4006-4b6c-8e39-3fb5d6be7d93 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:31.639062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1f652fe1-4006-4b6c-8e39-3fb5d6be7d93 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.403108 Jul 15 15:56:31.640995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 261/527] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:31 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:31.645750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5027e47d-d231-4e4c-aad4-edfc7918fd58 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:31.646571 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5027e47d-d231-4e4c-aad4-edfc7918fd58 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:31.654668 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5027e47d-d231-4e4c-aad4-edfc7918fd58 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:31.655653 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5027e47d-d231-4e4c-aad4-edfc7918fd58 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:31.660256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5027e47d-d231-4e4c-aad4-edfc7918fd58 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:31.660256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5027e47d-d231-4e4c-aad4-edfc7918fd58 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:31.860959 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-20ee8fda-cc0b-416d-9803-5fc1d65ea4dd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:31.874512 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-20ee8fda-cc0b-416d-9803-5fc1d65ea4dd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.303425 Jul 15 15:56:31.884450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 267/528] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:31 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:31.907384 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5027e47d-d231-4e4c-aad4-edfc7918fd58 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:31.917962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5027e47d-d231-4e4c-aad4-edfc7918fd58 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.275648 Jul 15 15:56:31.918983 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 262/529] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:31 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:32.658320 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6c8cf6ab-addf-41b3-9ab0-623333c59987 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:32.658934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6c8cf6ab-addf-41b3-9ab0-623333c59987 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:32.666490 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c8cf6ab-addf-41b3-9ab0-623333c59987 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:32.666950 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c8cf6ab-addf-41b3-9ab0-623333c59987 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:32.667774 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c8cf6ab-addf-41b3-9ab0-623333c59987 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:32.668216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c8cf6ab-addf-41b3-9ab0-623333c59987 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:32.806001 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6c8cf6ab-addf-41b3-9ab0-623333c59987 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:32.814055 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6c8cf6ab-addf-41b3-9ab0-623333c59987 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.159797 Jul 15 15:56:32.817077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 268/530] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:32 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:32.892416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0cd91c24-afa2-4d92-a758-e29891299ace tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:32.893185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0cd91c24-afa2-4d92-a758-e29891299ace tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:32.903044 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0cd91c24-afa2-4d92-a758-e29891299ace tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:32.903777 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0cd91c24-afa2-4d92-a758-e29891299ace tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:32.904737 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0cd91c24-afa2-4d92-a758-e29891299ace tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:32.905190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0cd91c24-afa2-4d92-a758-e29891299ace tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:32.938298 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-00259abe-2f62-401e-9087-9485a94acc5f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:32.941766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-00259abe-2f62-401e-9087-9485a94acc5f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:32.951637 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00259abe-2f62-401e-9087-9485a94acc5f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:32.953762 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00259abe-2f62-401e-9087-9485a94acc5f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:32.956146 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00259abe-2f62-401e-9087-9485a94acc5f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:32.958938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00259abe-2f62-401e-9087-9485a94acc5f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:33.200083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0cd91c24-afa2-4d92-a758-e29891299ace tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:33.211050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0cd91c24-afa2-4d92-a758-e29891299ace tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.321549 Jul 15 15:56:33.212723 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 263/531] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:32 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:33.245639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-00259abe-2f62-401e-9087-9485a94acc5f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:33.263813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-00259abe-2f62-401e-9087-9485a94acc5f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.330372 Jul 15 15:56:33.267412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 269/532] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:32 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:33.832081 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9e0fcedb-fda6-470d-a1af-b71283873c54 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:33.832805 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9e0fcedb-fda6-470d-a1af-b71283873c54 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:33.840246 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e0fcedb-fda6-470d-a1af-b71283873c54 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:33.840801 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e0fcedb-fda6-470d-a1af-b71283873c54 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:33.841703 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e0fcedb-fda6-470d-a1af-b71283873c54 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:33.842249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e0fcedb-fda6-470d-a1af-b71283873c54 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:33.848265 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:33.995695 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9e0fcedb-fda6-470d-a1af-b71283873c54 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:34.004593 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9e0fcedb-fda6-470d-a1af-b71283873c54 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.176558 Jul 15 15:56:34.005291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 264/533] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:33 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:34.230188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3d9ae0fa-2b06-40b3-9974-58e617589f61 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:34.230822 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3d9ae0fa-2b06-40b3-9974-58e617589f61 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:34.237641 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d9ae0fa-2b06-40b3-9974-58e617589f61 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:34.238090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d9ae0fa-2b06-40b3-9974-58e617589f61 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:34.238929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d9ae0fa-2b06-40b3-9974-58e617589f61 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:34.239392 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d9ae0fa-2b06-40b3-9974-58e617589f61 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:34.280963 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ab1421e0-5236-497e-a7fc-65929b1799ab tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:34.281494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ab1421e0-5236-497e-a7fc-65929b1799ab tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:34.288283 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ab1421e0-5236-497e-a7fc-65929b1799ab tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:34.288943 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ab1421e0-5236-497e-a7fc-65929b1799ab tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:34.289813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ab1421e0-5236-497e-a7fc-65929b1799ab tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:34.290230 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ab1421e0-5236-497e-a7fc-65929b1799ab tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:34.404219 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3d9ae0fa-2b06-40b3-9974-58e617589f61 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:34.416846 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3d9ae0fa-2b06-40b3-9974-58e617589f61 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.192210 Jul 15 15:56:34.430533 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 270/534] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:34 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:34.462454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ab1421e0-5236-497e-a7fc-65929b1799ab tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:34.472496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ab1421e0-5236-497e-a7fc-65929b1799ab tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.193280 Jul 15 15:56:34.472496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 265/535] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:34 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:35.022078 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9e8c59f0-fbc2-46d4-8395-2ff9ef80960b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:35.022766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9e8c59f0-fbc2-46d4-8395-2ff9ef80960b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:35.029333 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e8c59f0-fbc2-46d4-8395-2ff9ef80960b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:35.030116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e8c59f0-fbc2-46d4-8395-2ff9ef80960b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:35.030976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e8c59f0-fbc2-46d4-8395-2ff9ef80960b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:35.031522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e8c59f0-fbc2-46d4-8395-2ff9ef80960b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:35.165994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9e8c59f0-fbc2-46d4-8395-2ff9ef80960b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:35.173556 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9e8c59f0-fbc2-46d4-8395-2ff9ef80960b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.155722 Jul 15 15:56:35.174129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 271/536] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:35 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:35.433720 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bb084cb0-06cb-4278-bc4e-8c6d916884b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:35.434378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-bb084cb0-06cb-4278-bc4e-8c6d916884b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:35.440322 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bb084cb0-06cb-4278-bc4e-8c6d916884b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:35.440961 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bb084cb0-06cb-4278-bc4e-8c6d916884b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:35.441725 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bb084cb0-06cb-4278-bc4e-8c6d916884b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:35.442154 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bb084cb0-06cb-4278-bc4e-8c6d916884b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:35.488755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8f734239-2576-4e5b-aaa2-69195079e844 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:35.489372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8f734239-2576-4e5b-aaa2-69195079e844 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:35.499951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8f734239-2576-4e5b-aaa2-69195079e844 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:35.500405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8f734239-2576-4e5b-aaa2-69195079e844 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:35.501187 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8f734239-2576-4e5b-aaa2-69195079e844 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:35.501623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8f734239-2576-4e5b-aaa2-69195079e844 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:35.610359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-bb084cb0-06cb-4278-bc4e-8c6d916884b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:35.618666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-bb084cb0-06cb-4278-bc4e-8c6d916884b2 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.188654 Jul 15 15:56:35.619894 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 266/537] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:35 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:35.682813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8f734239-2576-4e5b-aaa2-69195079e844 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:35.690642 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8f734239-2576-4e5b-aaa2-69195079e844 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.205565 Jul 15 15:56:35.691285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 272/538] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:35 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:36.191074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2f091413-bde4-48fa-8555-d61da89150e7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:36.191725 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2f091413-bde4-48fa-8555-d61da89150e7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:36.198697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2f091413-bde4-48fa-8555-d61da89150e7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:36.199141 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2f091413-bde4-48fa-8555-d61da89150e7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:36.199936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2f091413-bde4-48fa-8555-d61da89150e7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:36.200418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2f091413-bde4-48fa-8555-d61da89150e7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:36.339330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2f091413-bde4-48fa-8555-d61da89150e7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:36.347778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2f091413-bde4-48fa-8555-d61da89150e7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.160324 Jul 15 15:56:36.348770 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 267/539] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:36 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:36.638516 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-03fedddb-2701-4393-a93b-7310aa6a29c6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:36.639847 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-03fedddb-2701-4393-a93b-7310aa6a29c6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:36.646735 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-03fedddb-2701-4393-a93b-7310aa6a29c6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:36.647177 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-03fedddb-2701-4393-a93b-7310aa6a29c6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:36.647970 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-03fedddb-2701-4393-a93b-7310aa6a29c6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:36.648408 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-03fedddb-2701-4393-a93b-7310aa6a29c6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:36.708025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6885aa30-9546-4861-b8a6-6cf9a11c9bd4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:36.708650 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6885aa30-9546-4861-b8a6-6cf9a11c9bd4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:36.716178 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6885aa30-9546-4861-b8a6-6cf9a11c9bd4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:36.716632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6885aa30-9546-4861-b8a6-6cf9a11c9bd4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:36.717430 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6885aa30-9546-4861-b8a6-6cf9a11c9bd4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:36.717871 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6885aa30-9546-4861-b8a6-6cf9a11c9bd4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:36.804416 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-03fedddb-2701-4393-a93b-7310aa6a29c6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:36.812953 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-03fedddb-2701-4393-a93b-7310aa6a29c6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.178306 Jul 15 15:56:36.813529 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 273/540] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:36 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:36.853880 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6885aa30-9546-4861-b8a6-6cf9a11c9bd4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:36.862724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6885aa30-9546-4861-b8a6-6cf9a11c9bd4 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.158664 Jul 15 15:56:36.863323 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 268/541] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:36 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:37.371799 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6046794d-c584-4f61-a695-943b32073813 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:37.371799 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6046794d-c584-4f61-a695-943b32073813 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:37.379599 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c7a7337b-53b0-40c9-9e18-afb4835b1198 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:37.380279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c7a7337b-53b0-40c9-9e18-afb4835b1198 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:37.395272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c7a7337b-53b0-40c9-9e18-afb4835b1198 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.395790 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c7a7337b-53b0-40c9-9e18-afb4835b1198 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:37.397130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c7a7337b-53b0-40c9-9e18-afb4835b1198 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.397573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c7a7337b-53b0-40c9-9e18-afb4835b1198 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:37.402568 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6046794d-c584-4f61-a695-943b32073813 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.406116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6046794d-c584-4f61-a695-943b32073813 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:37.407286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6046794d-c584-4f61-a695-943b32073813 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.408161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6046794d-c584-4f61-a695-943b32073813 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:37.436973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c7a7337b-53b0-40c9-9e18-afb4835b1198 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/ips" status: 200 len: 146 microversion: 2.1 time: 0.063848 Jul 15 15:56:37.441985 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 269/542] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 15:56:37 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/ips => generated 146 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:37.630055 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6046794d-c584-4f61-a695-943b32073813 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:37.638133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6046794d-c584-4f61-a695-943b32073813 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.272730 Jul 15 15:56:37.647726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 274/543] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:37 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:37.795380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-453efc99-7c7c-4848-a2f2-4b8601cd5412 req-ea8fa585-e1e1-40d6-875e-38b03da892ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6e6ea2-1ab6-4817-a02f-0c32dadb97b5", "tag": "bb3cde32-0415-4bd3-afe9-b8b361cc5127"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:37.804107 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-453efc99-7c7c-4848-a2f2-4b8601cd5412 req-ea8fa585-e1e1-40d6-875e-38b03da892ef service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.804653 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-453efc99-7c7c-4848-a2f2-4b8601cd5412 req-ea8fa585-e1e1-40d6-875e-38b03da892ef service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:37.817210 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-453efc99-7c7c-4848-a2f2-4b8601cd5412 req-ea8fa585-e1e1-40d6-875e-38b03da892ef service nova] Creating event network-changed:bb3cde32-0415-4bd3-afe9-b8b361cc5127 for instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 on hv-cinder-83587 Jul 15 15:56:37.826722 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-453efc99-7c7c-4848-a2f2-4b8601cd5412 req-ea8fa585-e1e1-40d6-875e-38b03da892ef service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031864 Jul 15 15:56:37.826722 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 270/544] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:37.828884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-70fede3f-f8b7-42e2-9935-2f1574fde0d9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:37.829320 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-70fede3f-f8b7-42e2-9935-2f1574fde0d9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:37.837402 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-70fede3f-f8b7-42e2-9935-2f1574fde0d9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.837925 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-70fede3f-f8b7-42e2-9935-2f1574fde0d9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:37.838750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-70fede3f-f8b7-42e2-9935-2f1574fde0d9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.839169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-70fede3f-f8b7-42e2-9935-2f1574fde0d9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:37.882198 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5fe47996-3450-44c8-9011-c0473fb70c6e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:37.882980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5fe47996-3450-44c8-9011-c0473fb70c6e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:37.890049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5fe47996-3450-44c8-9011-c0473fb70c6e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.890576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5fe47996-3450-44c8-9011-c0473fb70c6e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:37.891391 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5fe47996-3450-44c8-9011-c0473fb70c6e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:37.892010 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5fe47996-3450-44c8-9011-c0473fb70c6e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:38.004942 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-70fede3f-f8b7-42e2-9935-2f1574fde0d9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:38.013388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-70fede3f-f8b7-42e2-9935-2f1574fde0d9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.188612 Jul 15 15:56:38.014048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 275/545] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:37 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:38.050334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5fe47996-3450-44c8-9011-c0473fb70c6e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:38.055841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5fe47996-3450-44c8-9011-c0473fb70c6e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.178616 Jul 15 15:56:38.056447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 271/546] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:37 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:38.654436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0bd2fd63-0e8b-4030-af71-b305a9e51335 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:38.655149 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0bd2fd63-0e8b-4030-af71-b305a9e51335 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:38.661138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0bd2fd63-0e8b-4030-af71-b305a9e51335 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:38.661586 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0bd2fd63-0e8b-4030-af71-b305a9e51335 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:38.662347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0bd2fd63-0e8b-4030-af71-b305a9e51335 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:38.662777 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0bd2fd63-0e8b-4030-af71-b305a9e51335 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:38.884375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0bd2fd63-0e8b-4030-af71-b305a9e51335 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:38.892173 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0bd2fd63-0e8b-4030-af71-b305a9e51335 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.241581 Jul 15 15:56:38.892975 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 276/547] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:38 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:39.030661 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-630b2e89-89b2-42c2-861d-6c74e9a8e931 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:39.031274 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-630b2e89-89b2-42c2-861d-6c74e9a8e931 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:39.038053 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-630b2e89-89b2-42c2-861d-6c74e9a8e931 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:39.038513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-630b2e89-89b2-42c2-861d-6c74e9a8e931 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:39.039320 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-630b2e89-89b2-42c2-861d-6c74e9a8e931 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:39.039770 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-630b2e89-89b2-42c2-861d-6c74e9a8e931 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:39.073698 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3e22b01d-9912-4f46-9ada-0fefce80c037 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:39.074648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3e22b01d-9912-4f46-9ada-0fefce80c037 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:39.080773 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e22b01d-9912-4f46-9ada-0fefce80c037 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:39.081225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e22b01d-9912-4f46-9ada-0fefce80c037 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:39.082006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e22b01d-9912-4f46-9ada-0fefce80c037 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:39.082442 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e22b01d-9912-4f46-9ada-0fefce80c037 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:39.252460 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3e22b01d-9912-4f46-9ada-0fefce80c037 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:39.262533 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3e22b01d-9912-4f46-9ada-0fefce80c037 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.193351 Jul 15 15:56:39.263670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 277/548] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:39 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:39.278389 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-630b2e89-89b2-42c2-861d-6c74e9a8e931 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:39.285836 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-630b2e89-89b2-42c2-861d-6c74e9a8e931 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.259131 Jul 15 15:56:39.286769 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 272/549] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:39 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:39.909963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-996e108c-2c11-476a-a2ae-77295f22d524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:39.910583 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-996e108c-2c11-476a-a2ae-77295f22d524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:39.917908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-996e108c-2c11-476a-a2ae-77295f22d524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:39.918383 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-996e108c-2c11-476a-a2ae-77295f22d524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:39.920798 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-996e108c-2c11-476a-a2ae-77295f22d524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:39.920798 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-996e108c-2c11-476a-a2ae-77295f22d524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:40.117749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-996e108c-2c11-476a-a2ae-77295f22d524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:40.138823 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-996e108c-2c11-476a-a2ae-77295f22d524 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.232467 Jul 15 15:56:40.139459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 278/550] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:39 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:40.280748 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5b88d2d3-2cf4-42e7-9392-2e6b1a98ad35 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:40.281384 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5b88d2d3-2cf4-42e7-9392-2e6b1a98ad35 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:40.295259 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b88d2d3-2cf4-42e7-9392-2e6b1a98ad35 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:40.297224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b88d2d3-2cf4-42e7-9392-2e6b1a98ad35 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:40.298065 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b88d2d3-2cf4-42e7-9392-2e6b1a98ad35 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:40.298989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5b88d2d3-2cf4-42e7-9392-2e6b1a98ad35 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:40.304016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-00dbfbf9-d12e-4d85-876e-9aaf1441509a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:40.304916 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-00dbfbf9-d12e-4d85-876e-9aaf1441509a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:40.315615 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00dbfbf9-d12e-4d85-876e-9aaf1441509a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:40.317869 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00dbfbf9-d12e-4d85-876e-9aaf1441509a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:40.318887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00dbfbf9-d12e-4d85-876e-9aaf1441509a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:40.319542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00dbfbf9-d12e-4d85-876e-9aaf1441509a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:40.351256 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:40.491671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-00dbfbf9-d12e-4d85-876e-9aaf1441509a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:40.503632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-00dbfbf9-d12e-4d85-876e-9aaf1441509a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.201196 Jul 15 15:56:40.503793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5b88d2d3-2cf4-42e7-9392-2e6b1a98ad35 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:40.503897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 279/551] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:40 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:40.517274 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5b88d2d3-2cf4-42e7-9392-2e6b1a98ad35 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.240888 Jul 15 15:56:40.517848 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 273/552] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:40 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:41.156503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-94145c70-d8b3-4828-bd6a-95e51ff1fe98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:41.157137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-94145c70-d8b3-4828-bd6a-95e51ff1fe98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:41.163662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94145c70-d8b3-4828-bd6a-95e51ff1fe98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:41.164375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94145c70-d8b3-4828-bd6a-95e51ff1fe98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:41.165323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94145c70-d8b3-4828-bd6a-95e51ff1fe98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:41.165764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94145c70-d8b3-4828-bd6a-95e51ff1fe98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:41.342484 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-94145c70-d8b3-4828-bd6a-95e51ff1fe98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:41.351461 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-94145c70-d8b3-4828-bd6a-95e51ff1fe98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.198766 Jul 15 15:56:41.352057 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 280/553] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:41 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:41.517839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-518bc174-4c00-42ca-b7d4-8ef4b6a9d47a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:41.518442 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-518bc174-4c00-42ca-b7d4-8ef4b6a9d47a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:41.524715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-518bc174-4c00-42ca-b7d4-8ef4b6a9d47a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:41.525277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-518bc174-4c00-42ca-b7d4-8ef4b6a9d47a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:41.526062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-518bc174-4c00-42ca-b7d4-8ef4b6a9d47a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:41.526729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-518bc174-4c00-42ca-b7d4-8ef4b6a9d47a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:41.538702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-85ceda1b-24c6-406f-8b00-179f0d853649 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:41.539531 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-85ceda1b-24c6-406f-8b00-179f0d853649 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:41.551949 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-85ceda1b-24c6-406f-8b00-179f0d853649 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:41.556481 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-85ceda1b-24c6-406f-8b00-179f0d853649 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:41.557476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-85ceda1b-24c6-406f-8b00-179f0d853649 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:41.558684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-85ceda1b-24c6-406f-8b00-179f0d853649 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:41.712273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-518bc174-4c00-42ca-b7d4-8ef4b6a9d47a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:41.720032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-518bc174-4c00-42ca-b7d4-8ef4b6a9d47a tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.206286 Jul 15 15:56:41.720750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 274/554] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:41 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:41.775011 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-85ceda1b-24c6-406f-8b00-179f0d853649 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:41.782727 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-85ceda1b-24c6-406f-8b00-179f0d853649 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.252314 Jul 15 15:56:41.792285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 281/555] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:41 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:42.368913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f2f64118-de17-4349-971b-b4fd2a423274 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:42.369534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f2f64118-de17-4349-971b-b4fd2a423274 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:42.375758 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2f64118-de17-4349-971b-b4fd2a423274 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:42.376208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2f64118-de17-4349-971b-b4fd2a423274 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:42.377177 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2f64118-de17-4349-971b-b4fd2a423274 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:42.377624 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2f64118-de17-4349-971b-b4fd2a423274 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:42.498431 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-56e467d9-3f1e-41d0-a986-88f4ba73a8f8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e645f60a-93dd-446d-a7f9-68f694e0ebce"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:42.499620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-56e467d9-3f1e-41d0-a986-88f4ba73a8f8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:42.505926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-56e467d9-3f1e-41d0-a986-88f4ba73a8f8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:42.506383 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-56e467d9-3f1e-41d0-a986-88f4ba73a8f8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:42.507161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-56e467d9-3f1e-41d0-a986-88f4ba73a8f8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:42.508220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-56e467d9-3f1e-41d0-a986-88f4ba73a8f8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:42.516934 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f2f64118-de17-4349-971b-b4fd2a423274 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:42.525027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f2f64118-de17-4349-971b-b4fd2a423274 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.159988 Jul 15 15:56:42.534408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 275/556] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:42 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:42.737648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-52f70122-c9a3-4d57-9dd2-608013f2f7e7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:42.738188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-52f70122-c9a3-4d57-9dd2-608013f2f7e7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:42.744359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-52f70122-c9a3-4d57-9dd2-608013f2f7e7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:42.744810 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-52f70122-c9a3-4d57-9dd2-608013f2f7e7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:42.745579 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-52f70122-c9a3-4d57-9dd2-608013f2f7e7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:42.746018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-52f70122-c9a3-4d57-9dd2-608013f2f7e7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:42.894179 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-52f70122-c9a3-4d57-9dd2-608013f2f7e7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:42.901903 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-52f70122-c9a3-4d57-9dd2-608013f2f7e7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.168225 Jul 15 15:56:42.906262 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 276/557] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:42 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:42.907051 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fa98303e-71f7-40cc-8d40-7eb0951522e8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:42.907715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fa98303e-71f7-40cc-8d40-7eb0951522e8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:42.914068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa98303e-71f7-40cc-8d40-7eb0951522e8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:42.914526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa98303e-71f7-40cc-8d40-7eb0951522e8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:42.915312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa98303e-71f7-40cc-8d40-7eb0951522e8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:42.915766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa98303e-71f7-40cc-8d40-7eb0951522e8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:43.053980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fa98303e-71f7-40cc-8d40-7eb0951522e8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:43.062485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fa98303e-71f7-40cc-8d40-7eb0951522e8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.159030 Jul 15 15:56:43.063074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 277/558] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:42 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:43.542393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4cae4ceb-6a3c-47ab-8a1f-355fa74ba773 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:43.542999 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4cae4ceb-6a3c-47ab-8a1f-355fa74ba773 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:43.549247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4cae4ceb-6a3c-47ab-8a1f-355fa74ba773 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:43.549696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4cae4ceb-6a3c-47ab-8a1f-355fa74ba773 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:43.550466 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4cae4ceb-6a3c-47ab-8a1f-355fa74ba773 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:43.550902 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4cae4ceb-6a3c-47ab-8a1f-355fa74ba773 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:43.688439 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4cae4ceb-6a3c-47ab-8a1f-355fa74ba773 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:43.695765 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4cae4ceb-6a3c-47ab-8a1f-355fa74ba773 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.157689 Jul 15 15:56:43.696330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 278/559] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:43 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:43.700839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4a8edd02-ef7f-49f7-9afb-599f15808073 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:43.701333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4a8edd02-ef7f-49f7-9afb-599f15808073 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:43.707215 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4a8edd02-ef7f-49f7-9afb-599f15808073 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:43.707946 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4a8edd02-ef7f-49f7-9afb-599f15808073 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:43.708806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4a8edd02-ef7f-49f7-9afb-599f15808073 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:43.709245 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4a8edd02-ef7f-49f7-9afb-599f15808073 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:43.734272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4a8edd02-ef7f-49f7-9afb-599f15808073 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/ips" status: 200 len: 153 microversion: 2.20 time: 0.036924 Jul 15 15:56:43.735081 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 279/560] 10.222.0.98 () {60 vars in 1288 bytes} [Fri Jul 15 15:56:43 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:56:43.855150 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-52c39d71-0fcb-4b05-993d-403c5dbf67df req-10a46f06-b7e7-4bfb-9e2c-d3ca823a4f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d049f0c3-2447-4627-b276-74454c4f13fe", "name": "network-vif-plugged", "status": "completed", "tag": "e504616b-d5ea-4a8d-89f2-7ea9f3df5838"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:43.864406 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-52c39d71-0fcb-4b05-993d-403c5dbf67df req-10a46f06-b7e7-4bfb-9e2c-d3ca823a4f97 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:43.866370 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-52c39d71-0fcb-4b05-993d-403c5dbf67df req-10a46f06-b7e7-4bfb-9e2c-d3ca823a4f97 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:43.881719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-52c39d71-0fcb-4b05-993d-403c5dbf67df req-10a46f06-b7e7-4bfb-9e2c-d3ca823a4f97 service nova] Creating event network-vif-plugged:e504616b-d5ea-4a8d-89f2-7ea9f3df5838 for instance d049f0c3-2447-4627-b276-74454c4f13fe on hv-cinder-83587 Jul 15 15:56:43.887350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-52c39d71-0fcb-4b05-993d-403c5dbf67df req-10a46f06-b7e7-4bfb-9e2c-d3ca823a4f97 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036489 Jul 15 15:56:43.888211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 280/561] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:56:43.920393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-53b13cf5-4f8b-4915-807c-629e2a1213db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:43.920393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-53b13cf5-4f8b-4915-807c-629e2a1213db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:43.925896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-53b13cf5-4f8b-4915-807c-629e2a1213db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:43.926339 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-53b13cf5-4f8b-4915-807c-629e2a1213db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:43.927097 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-53b13cf5-4f8b-4915-807c-629e2a1213db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:43.927554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-53b13cf5-4f8b-4915-807c-629e2a1213db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:44.066329 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-53b13cf5-4f8b-4915-807c-629e2a1213db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:44.074642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-53b13cf5-4f8b-4915-807c-629e2a1213db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.159452 Jul 15 15:56:44.075126 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 281/562] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:43 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:44.079611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-61b13b4c-6be7-4d49-9aae-f6e461350ca6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:44.080223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-61b13b4c-6be7-4d49-9aae-f6e461350ca6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:44.087632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-61b13b4c-6be7-4d49-9aae-f6e461350ca6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:44.088087 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-61b13b4c-6be7-4d49-9aae-f6e461350ca6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:44.088870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-61b13b4c-6be7-4d49-9aae-f6e461350ca6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:44.089313 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-61b13b4c-6be7-4d49-9aae-f6e461350ca6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:44.223118 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-61b13b4c-6be7-4d49-9aae-f6e461350ca6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:44.229121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:44.232343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-61b13b4c-6be7-4d49-9aae-f6e461350ca6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.156223 Jul 15 15:56:44.232917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 282/563] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:44 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:44.713271 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5041af7c-a46b-443a-90b0-e404a65687ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:44.713876 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5041af7c-a46b-443a-90b0-e404a65687ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:44.720005 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5041af7c-a46b-443a-90b0-e404a65687ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:44.720453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5041af7c-a46b-443a-90b0-e404a65687ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:44.721212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5041af7c-a46b-443a-90b0-e404a65687ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:44.721647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5041af7c-a46b-443a-90b0-e404a65687ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:44.858166 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5041af7c-a46b-443a-90b0-e404a65687ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:44.865565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5041af7c-a46b-443a-90b0-e404a65687ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1366 microversion: 2.1 time: 0.156696 Jul 15 15:56:44.866137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 283/564] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:44 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:45.091357 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2ca6ae0b-ca1a-434b-a8a1-8f44009e7841 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:45.091984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2ca6ae0b-ca1a-434b-a8a1-8f44009e7841 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:45.098160 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2ca6ae0b-ca1a-434b-a8a1-8f44009e7841 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:45.098611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2ca6ae0b-ca1a-434b-a8a1-8f44009e7841 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:45.099418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2ca6ae0b-ca1a-434b-a8a1-8f44009e7841 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:45.099854 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2ca6ae0b-ca1a-434b-a8a1-8f44009e7841 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:45.240021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2ca6ae0b-ca1a-434b-a8a1-8f44009e7841 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:45.249765 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2ca6ae0b-ca1a-434b-a8a1-8f44009e7841 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.162697 Jul 15 15:56:45.250346 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 284/565] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:45 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:45.254910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bcd2b9f2-452b-4a1f-8aff-e7b21c6753a7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:45.255544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-bcd2b9f2-452b-4a1f-8aff-e7b21c6753a7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:45.264390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bcd2b9f2-452b-4a1f-8aff-e7b21c6753a7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:45.264845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bcd2b9f2-452b-4a1f-8aff-e7b21c6753a7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:45.265626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bcd2b9f2-452b-4a1f-8aff-e7b21c6753a7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:45.266080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bcd2b9f2-452b-4a1f-8aff-e7b21c6753a7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:45.423147 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-bcd2b9f2-452b-4a1f-8aff-e7b21c6753a7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:45.431373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-bcd2b9f2-452b-4a1f-8aff-e7b21c6753a7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.179924 Jul 15 15:56:45.431865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 285/566] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:45 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:45.883871 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9cad428a-514a-48ee-a5c5-a405ce5826f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:45.885343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9cad428a-514a-48ee-a5c5-a405ce5826f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:45.892516 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cad428a-514a-48ee-a5c5-a405ce5826f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:45.893092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cad428a-514a-48ee-a5c5-a405ce5826f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:45.894017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cad428a-514a-48ee-a5c5-a405ce5826f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:45.894464 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cad428a-514a-48ee-a5c5-a405ce5826f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:46.041652 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9cad428a-514a-48ee-a5c5-a405ce5826f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:46.050226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9cad428a-514a-48ee-a5c5-a405ce5826f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1554 microversion: 2.1 time: 0.171572 Jul 15 15:56:46.050807 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 286/567] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:45 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:46.067663 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-53d9d5f0-6db4-4ed1-a82e-4937e05173f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:46.068160 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-53d9d5f0-6db4-4ed1-a82e-4937e05173f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:46.074329 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-53d9d5f0-6db4-4ed1-a82e-4937e05173f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:46.074807 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-53d9d5f0-6db4-4ed1-a82e-4937e05173f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:46.075666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-53d9d5f0-6db4-4ed1-a82e-4937e05173f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:46.076101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-53d9d5f0-6db4-4ed1-a82e-4937e05173f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:46.150229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-56e467d9-3f1e-41d0-a986-88f4ba73a8f8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.655642 Jul 15 15:56:46.155647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 282/568] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 15:56:42 2022] POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/os-volume_attachments => generated 194 bytes in 3658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:56:46.158368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-53d9d5f0-6db4-4ed1-a82e-4937e05173f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093804 Jul 15 15:56:46.159684 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 287/569] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Jul 15 15:56:46 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:56:46.267249 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e4daab9f-dbef-4c93-bf46-d6f84fbc04eb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:46.268107 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e4daab9f-dbef-4c93-bf46-d6f84fbc04eb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:46.271861 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=77 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:46.276321 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4daab9f-dbef-4c93-bf46-d6f84fbc04eb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:46.277051 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4daab9f-dbef-4c93-bf46-d6f84fbc04eb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:46.277899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4daab9f-dbef-4c93-bf46-d6f84fbc04eb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:46.278410 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4daab9f-dbef-4c93-bf46-d6f84fbc04eb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:46.449047 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3e4ac92e-230d-4091-8e12-9cd9652184d9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:46.449581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3e4ac92e-230d-4091-8e12-9cd9652184d9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:46.471519 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3e4ac92e-230d-4091-8e12-9cd9652184d9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:46.471978 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3e4ac92e-230d-4091-8e12-9cd9652184d9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:46.472783 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3e4ac92e-230d-4091-8e12-9cd9652184d9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:46.473203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3e4ac92e-230d-4091-8e12-9cd9652184d9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:46.496219 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e4daab9f-dbef-4c93-bf46-d6f84fbc04eb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:46.504830 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e4daab9f-dbef-4c93-bf46-d6f84fbc04eb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.242383 Jul 15 15:56:46.505808 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 283/570] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:46 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:46.666492 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3e4ac92e-230d-4091-8e12-9cd9652184d9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:46.680007 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3e4ac92e-230d-4091-8e12-9cd9652184d9 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.229394 Jul 15 15:56:46.680007 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 288/571] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:46 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:47.199154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dbdd0db9-a7c2-42f1-8c0e-5a6b708ed517 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:47.200003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-dbdd0db9-a7c2-42f1-8c0e-5a6b708ed517 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:47.206831 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dbdd0db9-a7c2-42f1-8c0e-5a6b708ed517 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:47.209718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dbdd0db9-a7c2-42f1-8c0e-5a6b708ed517 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:47.209718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dbdd0db9-a7c2-42f1-8c0e-5a6b708ed517 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:47.209718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dbdd0db9-a7c2-42f1-8c0e-5a6b708ed517 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:47.234437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-dbdd0db9-a7c2-42f1-8c0e-5a6b708ed517 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lazy-loading 'flavor' on Instance uuid 652ce721-72c7-4314-8f15-bf94f30df443 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:56:47.522568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-cc0f48cb-16ee-4eec-9b77-832dd3622cbd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:47.523441 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-cc0f48cb-16ee-4eec-9b77-832dd3622cbd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:47.534375 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cc0f48cb-16ee-4eec-9b77-832dd3622cbd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:47.537856 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cc0f48cb-16ee-4eec-9b77-832dd3622cbd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:47.542673 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cc0f48cb-16ee-4eec-9b77-832dd3622cbd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:47.547350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cc0f48cb-16ee-4eec-9b77-832dd3622cbd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:47.728355 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-cc0f48cb-16ee-4eec-9b77-832dd3622cbd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:47.738123 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-cc0f48cb-16ee-4eec-9b77-832dd3622cbd tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.219706 Jul 15 15:56:47.738728 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 289/572] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:47 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:47.744216 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a54819cc-786a-46a2-9b51-b0620902f561 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:47.745019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a54819cc-786a-46a2-9b51-b0620902f561 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:47.752381 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a54819cc-786a-46a2-9b51-b0620902f561 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:47.753296 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a54819cc-786a-46a2-9b51-b0620902f561 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:47.754544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a54819cc-786a-46a2-9b51-b0620902f561 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:47.754984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a54819cc-786a-46a2-9b51-b0620902f561 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:47.958188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a54819cc-786a-46a2-9b51-b0620902f561 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:47.966899 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a54819cc-786a-46a2-9b51-b0620902f561 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1370 microversion: 2.1 time: 0.226866 Jul 15 15:56:47.967544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 290/573] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:47 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:47.981994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-bdfb19b3-1ced-456d-8ec2-95c480ef2dbc req-24fba516-d2fb-4df8-b831-2ee3ff1b40ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ed846f-5dcd-4d82-9aef-bd786bf6a6cf", "tag": "15a05a60-9557-46ed-a4b2-d512781fa87a"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:47.992861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-bdfb19b3-1ced-456d-8ec2-95c480ef2dbc req-24fba516-d2fb-4df8-b831-2ee3ff1b40ab service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:47.993386 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-bdfb19b3-1ced-456d-8ec2-95c480ef2dbc req-24fba516-d2fb-4df8-b831-2ee3ff1b40ab service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:48.005362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-bdfb19b3-1ced-456d-8ec2-95c480ef2dbc req-24fba516-d2fb-4df8-b831-2ee3ff1b40ab service nova] Creating event network-changed:15a05a60-9557-46ed-a4b2-d512781fa87a for instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf on hv-cinder-83587 Jul 15 15:56:48.011250 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-bdfb19b3-1ced-456d-8ec2-95c480ef2dbc req-24fba516-d2fb-4df8-b831-2ee3ff1b40ab service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033026 Jul 15 15:56:48.012574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 291/574] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:48.049093 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dbdd0db9-a7c2-42f1-8c0e-5a6b708ed517 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/action" status: 202 len: 0 microversion: 2.20 time: 0.848002 Jul 15 15:56:48.049093 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 284/575] 10.222.0.98 () {62 vars in 1318 bytes} [Fri Jul 15 15:56:47 2022] POST /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:56:48.053438 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:48.054194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:48.062283 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:48.062729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:48.063528 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:48.063964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:48.333298 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:48.346946 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:48.349928 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:48.353487 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-621a9219-73aa-42c1-a64e-580a55faa063 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.305060 Jul 15 15:56:48.356965 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 292/576] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:48 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:56:48.737610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-b689ae7d-3594-4cbb-a592-524d7e2d7192 req-34e8d1de-de84-4e41-a16a-a2ef1a4373a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6e6ea2-1ab6-4817-a02f-0c32dadb97b5", "name": "network-vif-plugged", "status": "completed", "tag": "bb3cde32-0415-4bd3-afe9-b8b361cc5127"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:48.751677 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-b689ae7d-3594-4cbb-a592-524d7e2d7192 req-34e8d1de-de84-4e41-a16a-a2ef1a4373a0 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:48.755082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-b689ae7d-3594-4cbb-a592-524d7e2d7192 req-34e8d1de-de84-4e41-a16a-a2ef1a4373a0 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:48.762472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-380c19b4-9dfa-4da1-b5f9-ca2a763938d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:48.764627 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-380c19b4-9dfa-4da1-b5f9-ca2a763938d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:48.772394 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-380c19b4-9dfa-4da1-b5f9-ca2a763938d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:48.773665 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-380c19b4-9dfa-4da1-b5f9-ca2a763938d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:48.776157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-380c19b4-9dfa-4da1-b5f9-ca2a763938d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:48.776825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-380c19b4-9dfa-4da1-b5f9-ca2a763938d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:48.781674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-b689ae7d-3594-4cbb-a592-524d7e2d7192 req-34e8d1de-de84-4e41-a16a-a2ef1a4373a0 service nova] Creating event network-vif-plugged:bb3cde32-0415-4bd3-afe9-b8b361cc5127 for instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 on hv-cinder-83587 Jul 15 15:56:48.790993 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-b689ae7d-3594-4cbb-a592-524d7e2d7192 req-34e8d1de-de84-4e41-a16a-a2ef1a4373a0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057785 Jul 15 15:56:48.792144 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 285/577] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:48.986392 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fce18154-6f6f-41bf-92a0-8e12fde5d365 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:48.987119 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fce18154-6f6f-41bf-92a0-8e12fde5d365 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:48.994636 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-380c19b4-9dfa-4da1-b5f9-ca2a763938d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:49.004245 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-380c19b4-9dfa-4da1-b5f9-ca2a763938d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.246098 Jul 15 15:56:49.007495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fce18154-6f6f-41bf-92a0-8e12fde5d365 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:49.007969 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fce18154-6f6f-41bf-92a0-8e12fde5d365 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:49.012754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fce18154-6f6f-41bf-92a0-8e12fde5d365 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:49.012754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fce18154-6f6f-41bf-92a0-8e12fde5d365 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:49.012950 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 293/578] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:48 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:49.179446 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fce18154-6f6f-41bf-92a0-8e12fde5d365 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:49.187435 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fce18154-6f6f-41bf-92a0-8e12fde5d365 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1564 microversion: 2.1 time: 0.207188 Jul 15 15:56:49.188016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 286/579] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:48 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:49.208421 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4babfc70-45fb-418d-8737-86b0d5c0c976 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:49.209284 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4babfc70-45fb-418d-8737-86b0d5c0c976 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:49.218233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4babfc70-45fb-418d-8737-86b0d5c0c976 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:49.218687 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4babfc70-45fb-418d-8737-86b0d5c0c976 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:49.219542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4babfc70-45fb-418d-8737-86b0d5c0c976 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:49.219979 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4babfc70-45fb-418d-8737-86b0d5c0c976 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:49.363179 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4babfc70-45fb-418d-8737-86b0d5c0c976 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160186 Jul 15 15:56:49.363891 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 294/580] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Jul 15 15:56:49 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:49.377279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:49.388810 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:49.397153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:49.397605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:49.400439 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:49.401243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:49.710732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:49.719897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:49.721419 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:49.722591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e4d0fcdc-1fb0-48ee-b32f-b668495c85a5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.350114 Jul 15 15:56:49.723154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 287/581] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:49 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:56:50.022822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c829c14e-8ec4-4a85-b990-5e99e7fc128d tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:50.024174 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c829c14e-8ec4-4a85-b990-5e99e7fc128d tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:50.026282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:50.031046 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c829c14e-8ec4-4a85-b990-5e99e7fc128d tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:50.031547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c829c14e-8ec4-4a85-b990-5e99e7fc128d tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:50.032327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c829c14e-8ec4-4a85-b990-5e99e7fc128d tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:50.032762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c829c14e-8ec4-4a85-b990-5e99e7fc128d tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:50.167373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c829c14e-8ec4-4a85-b990-5e99e7fc128d tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:50.175006 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c829c14e-8ec4-4a85-b990-5e99e7fc128d tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.156354 Jul 15 15:56:50.179887 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 295/582] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:50 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:50.595530 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-d9c2a6b7-aecb-42b3-a382-193f3eb67302 req-651ee6e2-1bbc-496d-a0bd-0e93040f472a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d049f0c3-2447-4627-b276-74454c4f13fe", "tag": "e504616b-d5ea-4a8d-89f2-7ea9f3df5838"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:50.604324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-d9c2a6b7-aecb-42b3-a382-193f3eb67302 req-651ee6e2-1bbc-496d-a0bd-0e93040f472a service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:50.604780 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-d9c2a6b7-aecb-42b3-a382-193f3eb67302 req-651ee6e2-1bbc-496d-a0bd-0e93040f472a service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:50.617991 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-d9c2a6b7-aecb-42b3-a382-193f3eb67302 req-651ee6e2-1bbc-496d-a0bd-0e93040f472a service nova] Creating event network-changed:e504616b-d5ea-4a8d-89f2-7ea9f3df5838 for instance d049f0c3-2447-4627-b276-74454c4f13fe on hv-cinder-83587 Jul 15 15:56:50.621689 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-d9c2a6b7-aecb-42b3-a382-193f3eb67302 req-651ee6e2-1bbc-496d-a0bd-0e93040f472a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029707 Jul 15 15:56:50.623255 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 288/583] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:50.742647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:50.744088 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:50.754622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:50.755268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:50.756895 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:50.758223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:50.927115 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:50.935567 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:50.937257 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:50.938515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3649af60-395d-492d-aa7e-d6dac5d416b8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.201060 Jul 15 15:56:50.939147 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 296/584] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:50 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:56:51.193030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-db981e2f-0db9-46a6-a61c-c5eae9ca4a38 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:51.193732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-db981e2f-0db9-46a6-a61c-c5eae9ca4a38 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:51.200003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db981e2f-0db9-46a6-a61c-c5eae9ca4a38 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:51.200455 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db981e2f-0db9-46a6-a61c-c5eae9ca4a38 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:51.201228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db981e2f-0db9-46a6-a61c-c5eae9ca4a38 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:51.201663 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db981e2f-0db9-46a6-a61c-c5eae9ca4a38 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:51.345539 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-db981e2f-0db9-46a6-a61c-c5eae9ca4a38 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:51.353871 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-db981e2f-0db9-46a6-a61c-c5eae9ca4a38 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1357 microversion: 2.1 time: 0.165028 Jul 15 15:56:51.354527 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 289/585] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:51 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:51.957561 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:51.958172 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:51.965278 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:51.965732 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:51.966507 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:51.966928 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.113355 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:52.122621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:52.124189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:52.125346 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5c060b31-38be-4874-862b-0958dfa210c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.171687 Jul 15 15:56:52.125897 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 297/586] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:51 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:56:52.370393 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-eb125944-4ff1-4671-8ddd-4e77fb42d27c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:52.371003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-eb125944-4ff1-4671-8ddd-4e77fb42d27c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:52.379371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eb125944-4ff1-4671-8ddd-4e77fb42d27c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.379857 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eb125944-4ff1-4671-8ddd-4e77fb42d27c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.380633 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eb125944-4ff1-4671-8ddd-4e77fb42d27c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.381383 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eb125944-4ff1-4671-8ddd-4e77fb42d27c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.518089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1684392160", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:52.518611 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-eb125944-4ff1-4671-8ddd-4e77fb42d27c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:52.526228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-eb125944-4ff1-4671-8ddd-4e77fb42d27c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1547 microversion: 2.1 time: 0.160034 Jul 15 15:56:52.527030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 290/587] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:52 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:52.543195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-68e3df2e-9817-4bdd-8c13-8152ad415fdb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:52.543864 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-68e3df2e-9817-4bdd-8c13-8152ad415fdb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:52.549695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-68e3df2e-9817-4bdd-8c13-8152ad415fdb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.550140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-68e3df2e-9817-4bdd-8c13-8152ad415fdb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.550923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-68e3df2e-9817-4bdd-8c13-8152ad415fdb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.551381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-68e3df2e-9817-4bdd-8c13-8152ad415fdb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.568959 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] validate_networks() for None {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:56:52.689837 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-68e3df2e-9817-4bdd-8c13-8152ad415fdb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:52.697806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-68e3df2e-9817-4bdd-8c13-8152ad415fdb tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1547 microversion: 2.1 time: 0.158268 Jul 15 15:56:52.698375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 291/588] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:52 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:52.714006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:52.723784 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:52.724683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Searching by: {'deleted': False, 'project_id': '06d54c4865ff45e59526d477accb6cc4'} {{(pid=130090) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 15 15:56:52.734594 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.735047 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.735889 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.736333 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.827279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.multi_cell_list [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130090) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 15 15:56:52.854011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:56:52.854426 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:56:52.854917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:56:52.855348 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:56:52.855780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:56:52.865381 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.865823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.866612 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.867046 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.884098 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Getting quotas for project 3f2dce4132ee48c7879319206fcee635. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:56:52.888033 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Getting quotas for user a9e02c61bdce42ab9ffff539b231ecc7 and project 3f2dce4132ee48c7879319206fcee635. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:56:52.899868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:56:52.902117 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:56:52.931848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d72aa272-c68e-4e83-a18a-2ae2373ca97c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.216224 Jul 15 15:56:52.931848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 292/589] 10.222.0.98 () {58 vars in 1124 bytes} [Fri Jul 15 15:56:52 2022] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:56:52.939183 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5ad3eb4b-0dcd-4226-818b-14fbb5c3f47f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:52.939183 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5ad3eb4b-0dcd-4226-818b-14fbb5c3f47f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:52.942905 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5ad3eb4b-0dcd-4226-818b-14fbb5c3f47f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.943490 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5ad3eb4b-0dcd-4226-818b-14fbb5c3f47f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:52.944314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5ad3eb4b-0dcd-4226-818b-14fbb5c3f47f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:52.945477 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5ad3eb4b-0dcd-4226-818b-14fbb5c3f47f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:53.078495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5ad3eb4b-0dcd-4226-818b-14fbb5c3f47f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:53.082312 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:53.090041 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5ad3eb4b-0dcd-4226-818b-14fbb5c3f47f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1547 microversion: 2.1 time: 0.157346 Jul 15 15:56:53.102026 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 293/590] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:52 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:53.111517 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7f39781e-6907-49e3-9e39-b88d6e250bf0 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597146 Jul 15 15:56:53.117108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 298/591] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 15:56:53.122395 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8f2f67df-ba95-4141-97ef-caaafaa3b969 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:53.123022 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8f2f67df-ba95-4141-97ef-caaafaa3b969 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:53.143693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:53.144394 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:53.152041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:53.152573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:53.153429 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:53.153941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:53.193440 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8f2f67df-ba95-4141-97ef-caaafaa3b969 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:53.201233 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8f2f67df-ba95-4141-97ef-caaafaa3b969 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1215 microversion: 2.1 time: 0.082711 Jul 15 15:56:53.207712 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 294/592] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:53 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:53.320615 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:53.328451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:53.329983 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:53.331028 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-237b822d-a4ad-4f6d-a1b7-af7bd678efd6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.191916 Jul 15 15:56:53.331626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 299/593] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:53 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:56:54.218725 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cca8a912-e31d-49e3-b146-6531c510a0dd tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:54.219372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cca8a912-e31d-49e3-b146-6531c510a0dd tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:54.273863 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cca8a912-e31d-49e3-b146-6531c510a0dd tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:54.282043 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cca8a912-e31d-49e3-b146-6531c510a0dd tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1215 microversion: 2.1 time: 0.067186 Jul 15 15:56:54.282690 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 295/594] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:54 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:54.349534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:54.350195 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:54.356325 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:54.356772 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:54.357541 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:54.357973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:54.487534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:54.495395 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:54.496883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:54.498026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-15c9f1ef-81c5-4448-9045-35e8789f0e5f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.152386 Jul 15 15:56:54.498582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 300/595] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:54 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:56:55.299666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-136bab1b-476d-4f6d-9506-4afa8587cb3a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:55.300900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-136bab1b-476d-4f6d-9506-4afa8587cb3a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:55.308146 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-136bab1b-476d-4f6d-9506-4afa8587cb3a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:55.308603 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-136bab1b-476d-4f6d-9506-4afa8587cb3a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:55.309389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-136bab1b-476d-4f6d-9506-4afa8587cb3a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:55.309855 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-136bab1b-476d-4f6d-9506-4afa8587cb3a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:55.370180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-136bab1b-476d-4f6d-9506-4afa8587cb3a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:55.377550 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-136bab1b-476d-4f6d-9506-4afa8587cb3a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1211 microversion: 2.1 time: 0.083324 Jul 15 15:56:55.378117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 296/596] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:55 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:55.516674 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:55.517289 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:55.524053 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:55.524510 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:55.525287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:55.525731 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:55.544273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:56:55.659467 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:55.667819 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:55.669322 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:55.670475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d45ef93b-8ad0-4289-9a5f-fd93d9efb169 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.157757 Jul 15 15:56:55.671214 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 301/597] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:55 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:56:55.987154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-343f1592-6c6c-4e2b-b0bf-4c2a924af824 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:55.993221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-343f1592-6c6c-4e2b-b0bf-4c2a924af824 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:55.993669 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-343f1592-6c6c-4e2b-b0bf-4c2a924af824 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:56.065663 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-343f1592-6c6c-4e2b-b0bf-4c2a924af824 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Going to try to stop instance {{(pid=130090) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 15:56:56.250242 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-86ae438c-da50-4ce7-bab1-521903256a62 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75a8bcd5-53ec-46de-b324-997adec631b1"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:56.251393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-86ae438c-da50-4ce7-bab1-521903256a62 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:56.258861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-86ae438c-da50-4ce7-bab1-521903256a62 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:56.259418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-86ae438c-da50-4ce7-bab1-521903256a62 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:56.260207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-86ae438c-da50-4ce7-bab1-521903256a62 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:56.260649 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-86ae438c-da50-4ce7-bab1-521903256a62 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:56.351177 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-343f1592-6c6c-4e2b-b0bf-4c2a924af824 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/action" status: 202 len: 0 microversion: 2.1 time: 0.367398 Jul 15 15:56:56.351973 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 297/598] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:56:55 2022] POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:56:56.362074 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-db851d02-ca36-4185-bf84-12197eec3c01 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:56.362784 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-db851d02-ca36-4185-bf84-12197eec3c01 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:56.369734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db851d02-ca36-4185-bf84-12197eec3c01 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:56.370188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db851d02-ca36-4185-bf84-12197eec3c01 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:56.370960 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db851d02-ca36-4185-bf84-12197eec3c01 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:56.371427 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db851d02-ca36-4185-bf84-12197eec3c01 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:56.550821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-db851d02-ca36-4185-bf84-12197eec3c01 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:56.559091 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-db851d02-ca36-4185-bf84-12197eec3c01 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.202775 Jul 15 15:56:56.574296 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 298/599] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:56 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:56.574296 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-052e4738-6e53-49d8-8506-1f3bbcb5c30a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:56.574296 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-052e4738-6e53-49d8-8506-1f3bbcb5c30a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:56.574296 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-052e4738-6e53-49d8-8506-1f3bbcb5c30a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:56.574629 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-052e4738-6e53-49d8-8506-1f3bbcb5c30a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:56.574629 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-052e4738-6e53-49d8-8506-1f3bbcb5c30a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:56.574629 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-052e4738-6e53-49d8-8506-1f3bbcb5c30a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:56.668786 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-052e4738-6e53-49d8-8506-1f3bbcb5c30a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:56.676205 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-052e4738-6e53-49d8-8506-1f3bbcb5c30a tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1275 microversion: 2.1 time: 0.115544 Jul 15 15:56:56.676788 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 299/600] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:56 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:56.688852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:56.689591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:56.696304 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:56.696674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:56.697439 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:56.697882 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:57.141335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:57.150010 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:57.151537 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:57.152723 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-17825d41-8586-47d8-80b6-74461c42d4f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.468005 Jul 15 15:56:57.153842 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 300/601] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:56 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:56:57.576669 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3eb521ad-9830-4f71-8c64-aa16aea9c4e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:57.577312 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3eb521ad-9830-4f71-8c64-aa16aea9c4e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:57.583916 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3eb521ad-9830-4f71-8c64-aa16aea9c4e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:57.584365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3eb521ad-9830-4f71-8c64-aa16aea9c4e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:57.585150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3eb521ad-9830-4f71-8c64-aa16aea9c4e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:57.585584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3eb521ad-9830-4f71-8c64-aa16aea9c4e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:57.594241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-86ae438c-da50-4ce7-bab1-521903256a62 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "POST /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.347802 Jul 15 15:56:57.594954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 302/602] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 15:56:56 2022] POST /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments => generated 194 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:56:57.693820 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1f4bc32d-55ac-469d-a294-292410b4e587 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:57.694649 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1f4bc32d-55ac-469d-a294-292410b4e587 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:57.701631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f4bc32d-55ac-469d-a294-292410b4e587 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:57.702079 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f4bc32d-55ac-469d-a294-292410b4e587 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:57.702856 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f4bc32d-55ac-469d-a294-292410b4e587 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:57.703315 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f4bc32d-55ac-469d-a294-292410b4e587 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:57.766450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1f4bc32d-55ac-469d-a294-292410b4e587 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:57.774672 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1f4bc32d-55ac-469d-a294-292410b4e587 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1273 microversion: 2.1 time: 0.085007 Jul 15 15:56:57.785411 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 303/603] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:57 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:57.806772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3eb521ad-9830-4f71-8c64-aa16aea9c4e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:57.814935 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3eb521ad-9830-4f71-8c64-aa16aea9c4e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.242332 Jul 15 15:56:57.815546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 301/604] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:57 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:56:58.170986 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:58.173795 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:58.181882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:58.182566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:58.183674 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:58.184253 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:58.343902 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:58.353383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:58.354879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:58.356124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f56d3880-a651-4789-a806-982d0756d598 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.188965 Jul 15 15:56:58.356678 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 304/605] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:58 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:56:58.791847 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-409d94a5-e56c-418d-a8ba-e6e8afb85d71 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:58.792466 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-409d94a5-e56c-418d-a8ba-e6e8afb85d71 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:58.799174 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-409d94a5-e56c-418d-a8ba-e6e8afb85d71 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:58.799669 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-409d94a5-e56c-418d-a8ba-e6e8afb85d71 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:58.800532 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-409d94a5-e56c-418d-a8ba-e6e8afb85d71 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:58.800913 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-409d94a5-e56c-418d-a8ba-e6e8afb85d71 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:58.833849 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-64e08551-678a-4620-aac9-17b7a841cfa6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:58.835871 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-64e08551-678a-4620-aac9-17b7a841cfa6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:58.848019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64e08551-678a-4620-aac9-17b7a841cfa6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:58.848472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64e08551-678a-4620-aac9-17b7a841cfa6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:58.849480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64e08551-678a-4620-aac9-17b7a841cfa6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:58.849943 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64e08551-678a-4620-aac9-17b7a841cfa6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:59.017419 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-64e08551-678a-4620-aac9-17b7a841cfa6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:59.028267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-64e08551-678a-4620-aac9-17b7a841cfa6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.199593 Jul 15 15:56:59.028848 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 305/606] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:58 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:59.072713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-409d94a5-e56c-418d-a8ba-e6e8afb85d71 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:59.080227 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-409d94a5-e56c-418d-a8ba-e6e8afb85d71 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.292246 Jul 15 15:56:59.080981 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 302/607] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:56:58 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:56:59.227929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-a0c9e620-318a-477e-ae7b-fa89d57f44e4 req-1dbab240-f735-4345-9e96-267c87de5f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a93327-6cc1-4c7d-bf18-7ff61407d195", "tag": "8dc1ab8a-8325-4822-a448-42037a7d9e0b"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:56:59.245052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-a0c9e620-318a-477e-ae7b-fa89d57f44e4 req-1dbab240-f735-4345-9e96-267c87de5f99 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:59.245759 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-a0c9e620-318a-477e-ae7b-fa89d57f44e4 req-1dbab240-f735-4345-9e96-267c87de5f99 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:59.262729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-a0c9e620-318a-477e-ae7b-fa89d57f44e4 req-1dbab240-f735-4345-9e96-267c87de5f99 service nova] Creating event network-changed:8dc1ab8a-8325-4822-a448-42037a7d9e0b for instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 on hv-cinder-83587 Jul 15 15:56:59.269025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-a0c9e620-318a-477e-ae7b-fa89d57f44e4 req-1dbab240-f735-4345-9e96-267c87de5f99 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045071 Jul 15 15:56:59.269939 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 306/608] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:56:59.378499 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:56:59.378985 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:56:59.386730 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:59.387260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:59.388139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:56:59.388571 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:56:59.630402 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:59.639178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:59.640731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:56:59.641907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4ca51deb-7531-426b-8d34-0f5132e03bbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.271783 Jul 15 15:56:59.642476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 303/609] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:56:59 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:00.045770 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e8065fc9-8c11-4bf4-bd04-c301e0fe38bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:00.046459 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e8065fc9-8c11-4bf4-bd04-c301e0fe38bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:00.053587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8065fc9-8c11-4bf4-bd04-c301e0fe38bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:00.053587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8065fc9-8c11-4bf4-bd04-c301e0fe38bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:00.054025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8065fc9-8c11-4bf4-bd04-c301e0fe38bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:00.054390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8065fc9-8c11-4bf4-bd04-c301e0fe38bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:00.097896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-694943fa-8741-4030-b6a3-f27144e84abc tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:00.098858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-694943fa-8741-4030-b6a3-f27144e84abc tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:00.108228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-694943fa-8741-4030-b6a3-f27144e84abc tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:00.108873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-694943fa-8741-4030-b6a3-f27144e84abc tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:00.109794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-694943fa-8741-4030-b6a3-f27144e84abc tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:00.110380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-694943fa-8741-4030-b6a3-f27144e84abc tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:00.209401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e8065fc9-8c11-4bf4-bd04-c301e0fe38bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:00.218398 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e8065fc9-8c11-4bf4-bd04-c301e0fe38bd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.176907 Jul 15 15:57:00.218975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 307/610] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:00 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:00.254148 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-694943fa-8741-4030-b6a3-f27144e84abc tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:00.262228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-694943fa-8741-4030-b6a3-f27144e84abc tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.169411 Jul 15 15:57:00.262802 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 304/611] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:00 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:00.660568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:00.661173 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:00.667560 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:00.668004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:00.668798 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:00.669234 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:00.796770 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:00.805187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:00.806690 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:00.807910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9d1af5b1-f1c5-4ddb-867b-928c81c30cf8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.151243 Jul 15 15:57:00.808470 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 308/612] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:00 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:01.236371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6a5ee34a-fa21-4be6-be93-823ed141c74b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:01.236993 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6a5ee34a-fa21-4be6-be93-823ed141c74b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:01.244645 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6a5ee34a-fa21-4be6-be93-823ed141c74b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:01.245093 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6a5ee34a-fa21-4be6-be93-823ed141c74b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:01.245881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6a5ee34a-fa21-4be6-be93-823ed141c74b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:01.246314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6a5ee34a-fa21-4be6-be93-823ed141c74b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:01.279119 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-aab00509-2a1f-4ed5-b20a-71bbf5ca9654 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:01.279868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-aab00509-2a1f-4ed5-b20a-71bbf5ca9654 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:01.286393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aab00509-2a1f-4ed5-b20a-71bbf5ca9654 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:01.286853 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aab00509-2a1f-4ed5-b20a-71bbf5ca9654 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:01.287665 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aab00509-2a1f-4ed5-b20a-71bbf5ca9654 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:01.288797 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aab00509-2a1f-4ed5-b20a-71bbf5ca9654 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:01.381394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6a5ee34a-fa21-4be6-be93-823ed141c74b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:01.390100 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6a5ee34a-fa21-4be6-be93-823ed141c74b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.157573 Jul 15 15:57:01.390685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 305/613] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:01 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:01.419704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-aab00509-2a1f-4ed5-b20a-71bbf5ca9654 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:01.426344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-aab00509-2a1f-4ed5-b20a-71bbf5ca9654 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.151098 Jul 15 15:57:01.426900 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 309/614] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:01 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:01.826334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:01.826859 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:01.833204 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:01.833659 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:01.834431 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:01.834873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:01.965096 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:01.973195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:01.974687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:01.976374 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fe942490-960d-4b04-b701-ec521b92d9e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.154127 Jul 15 15:57:01.976972 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 306/615] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:01 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:02.407998 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-349eecd3-323d-433e-aa8c-e824c3225840 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:02.408596 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-349eecd3-323d-433e-aa8c-e824c3225840 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:02.415047 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-349eecd3-323d-433e-aa8c-e824c3225840 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:02.415539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-349eecd3-323d-433e-aa8c-e824c3225840 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:02.416311 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-349eecd3-323d-433e-aa8c-e824c3225840 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:02.416748 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-349eecd3-323d-433e-aa8c-e824c3225840 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:02.442853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f90618ea-8f21-4aea-91c3-648d4a4dc61b tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:02.443517 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f90618ea-8f21-4aea-91c3-648d4a4dc61b tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:02.450849 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f90618ea-8f21-4aea-91c3-648d4a4dc61b tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:02.451317 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f90618ea-8f21-4aea-91c3-648d4a4dc61b tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:02.452114 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f90618ea-8f21-4aea-91c3-648d4a4dc61b tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:02.452554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f90618ea-8f21-4aea-91c3-648d4a4dc61b tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:02.549387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-349eecd3-323d-433e-aa8c-e824c3225840 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:02.558058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-349eecd3-323d-433e-aa8c-e824c3225840 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.153671 Jul 15 15:57:02.559126 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 310/616] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:02 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:02.599210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f90618ea-8f21-4aea-91c3-648d4a4dc61b tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:02.607066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f90618ea-8f21-4aea-91c3-648d4a4dc61b tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.168029 Jul 15 15:57:02.607675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 307/617] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:02 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:02.994286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:02.994886 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:02.996886 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:03.004183 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=6 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:03.004183 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:03.004183 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:03.004183 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:03.004562 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:03.135806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:03.143695 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:03.145168 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:03.146294 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c2bb9cec-86f7-4276-8632-2affea09a74c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.155975 Jul 15 15:57:03.146847 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 311/618] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:02 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:03.578878 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2ce9cebb-8b16-48ee-8ab6-ddd62a7512d0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:03.579540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2ce9cebb-8b16-48ee-8ab6-ddd62a7512d0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:03.581578 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:03.587572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2ce9cebb-8b16-48ee-8ab6-ddd62a7512d0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:03.588030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2ce9cebb-8b16-48ee-8ab6-ddd62a7512d0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:03.588805 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2ce9cebb-8b16-48ee-8ab6-ddd62a7512d0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:03.589246 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2ce9cebb-8b16-48ee-8ab6-ddd62a7512d0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:03.623378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-773610aa-e75d-4d38-8acd-7a8be7350cec tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:03.623980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-773610aa-e75d-4d38-8acd-7a8be7350cec tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:03.630472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-773610aa-e75d-4d38-8acd-7a8be7350cec tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:03.630923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-773610aa-e75d-4d38-8acd-7a8be7350cec tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:03.632299 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-773610aa-e75d-4d38-8acd-7a8be7350cec tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:03.632812 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-773610aa-e75d-4d38-8acd-7a8be7350cec tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:03.724980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2ce9cebb-8b16-48ee-8ab6-ddd62a7512d0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:03.737444 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2ce9cebb-8b16-48ee-8ab6-ddd62a7512d0 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.162298 Jul 15 15:57:03.738018 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 308/619] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:03 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:03.775655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-773610aa-e75d-4d38-8acd-7a8be7350cec tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:03.783041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-773610aa-e75d-4d38-8acd-7a8be7350cec tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.163556 Jul 15 15:57:03.783635 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 312/620] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:03 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:04.164779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:04.165425 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:04.171406 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:04.171858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:04.172656 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:04.173108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:04.279444 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=4 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:04.311740 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:04.317863 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:04.319379 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:04.320536 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2351a23e-d4f0-414e-83ab-3fa2cfb9ee10 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.160707 Jul 15 15:57:04.321095 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 309/621] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:04 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:04.753682 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-eae56edf-b220-4503-adac-88ef85a471c6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:04.754284 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-eae56edf-b220-4503-adac-88ef85a471c6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:04.760832 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eae56edf-b220-4503-adac-88ef85a471c6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:04.761277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eae56edf-b220-4503-adac-88ef85a471c6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:04.762040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eae56edf-b220-4503-adac-88ef85a471c6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:04.762492 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eae56edf-b220-4503-adac-88ef85a471c6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:04.799630 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-964a6039-0544-4f90-b5ed-aa8029d972a9 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:04.802009 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-964a6039-0544-4f90-b5ed-aa8029d972a9 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:04.807626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-964a6039-0544-4f90-b5ed-aa8029d972a9 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:04.808079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-964a6039-0544-4f90-b5ed-aa8029d972a9 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:04.808917 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-964a6039-0544-4f90-b5ed-aa8029d972a9 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:04.810094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-964a6039-0544-4f90-b5ed-aa8029d972a9 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:04.894037 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eae56edf-b220-4503-adac-88ef85a471c6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:04.902479 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-eae56edf-b220-4503-adac-88ef85a471c6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.152603 Jul 15 15:57:04.903152 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 313/622] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:04 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:04.940427 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-964a6039-0544-4f90-b5ed-aa8029d972a9 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:04.948634 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-964a6039-0544-4f90-b5ed-aa8029d972a9 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.153139 Jul 15 15:57:04.949215 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 310/623] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:04 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:05.338973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:05.339616 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:05.345569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:05.346032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:05.346806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:05.347249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:05.485542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:05.493869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:05.495376 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:05.496526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-42bec267-7674-4b2e-8c1f-60c72893511f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.162354 Jul 15 15:57:05.497085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 314/624] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:05 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:05.919949 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-80ff124c-31e4-4785-90cd-a009b3ca0b03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:05.920565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-80ff124c-31e4-4785-90cd-a009b3ca0b03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:05.927139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80ff124c-31e4-4785-90cd-a009b3ca0b03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:05.927576 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80ff124c-31e4-4785-90cd-a009b3ca0b03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:05.928380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80ff124c-31e4-4785-90cd-a009b3ca0b03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:05.928819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80ff124c-31e4-4785-90cd-a009b3ca0b03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:05.947445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:05.966230 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-435fd1e5-22bd-414f-bd44-164bfc685fd2 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:05.966911 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-435fd1e5-22bd-414f-bd44-164bfc685fd2 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:05.973900 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-435fd1e5-22bd-414f-bd44-164bfc685fd2 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:05.982474 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-435fd1e5-22bd-414f-bd44-164bfc685fd2 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:05.982474 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-435fd1e5-22bd-414f-bd44-164bfc685fd2 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:05.982474 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-435fd1e5-22bd-414f-bd44-164bfc685fd2 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:06.083736 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-80ff124c-31e4-4785-90cd-a009b3ca0b03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:06.093307 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-80ff124c-31e4-4785-90cd-a009b3ca0b03 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.177364 Jul 15 15:57:06.096159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 311/625] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:05 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:06.135033 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-435fd1e5-22bd-414f-bd44-164bfc685fd2 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:06.143786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-435fd1e5-22bd-414f-bd44-164bfc685fd2 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.181419 Jul 15 15:57:06.144369 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 315/626] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:05 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:06.514845 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:06.515415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:06.521899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:06.522899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:06.523700 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:06.524139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:06.655401 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:06.663229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:06.664858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:06.669120 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1351bb67-5455-4c39-8c93-5727c6ed8cca tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1744 microversion: 2.20 time: 0.155457 Jul 15 15:57:06.669120 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 312/627] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:06 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:07.116500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2b4cb3f2-cace-4d92-bef1-3b0417c1e657 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:07.117862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2b4cb3f2-cace-4d92-bef1-3b0417c1e657 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:07.128246 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b4cb3f2-cace-4d92-bef1-3b0417c1e657 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:07.128692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b4cb3f2-cace-4d92-bef1-3b0417c1e657 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:07.129476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b4cb3f2-cace-4d92-bef1-3b0417c1e657 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:07.129917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b4cb3f2-cace-4d92-bef1-3b0417c1e657 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:07.161600 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-db290ce0-97a4-423e-be5e-4b62a54b0ac3 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:07.162342 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-db290ce0-97a4-423e-be5e-4b62a54b0ac3 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:07.169329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db290ce0-97a4-423e-be5e-4b62a54b0ac3 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:07.170587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db290ce0-97a4-423e-be5e-4b62a54b0ac3 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:07.171586 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db290ce0-97a4-423e-be5e-4b62a54b0ac3 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:07.172035 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-db290ce0-97a4-423e-be5e-4b62a54b0ac3 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:07.302343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2b4cb3f2-cace-4d92-bef1-3b0417c1e657 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:07.313697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2b4cb3f2-cace-4d92-bef1-3b0417c1e657 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.201367 Jul 15 15:57:07.315083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 316/628] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:07 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:07.338712 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9b93627b-7ac9-4754-9732-6cff698a82b6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:07.339875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9b93627b-7ac9-4754-9732-6cff698a82b6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:07.342331 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-db290ce0-97a4-423e-be5e-4b62a54b0ac3 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:07.347719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9b93627b-7ac9-4754-9732-6cff698a82b6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:07.348202 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9b93627b-7ac9-4754-9732-6cff698a82b6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:07.349217 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9b93627b-7ac9-4754-9732-6cff698a82b6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:07.349723 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9b93627b-7ac9-4754-9732-6cff698a82b6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:07.353530 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-db290ce0-97a4-423e-be5e-4b62a54b0ac3 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.196801 Jul 15 15:57:07.354239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 313/629] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:07 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:07.370713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:07.486458 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9b93627b-7ac9-4754-9732-6cff698a82b6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:07.495416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9b93627b-7ac9-4754-9732-6cff698a82b6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1593 microversion: 2.1 time: 0.161183 Jul 15 15:57:07.497207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 317/630] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:07 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1593 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:07.685528 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:07.686143 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:07.698221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:07.698221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:07.698221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:07.698221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:07.892972 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:07.902112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:07.904367 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:07.906165 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-14b1164a-f640-4b03-8505-1f0577b45f12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1744 microversion: 2.20 time: 0.224593 Jul 15 15:57:07.918086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 314/631] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:07 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:08.334842 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ff0ed027-9ceb-4c70-b389-31eedf2e3714 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:08.335846 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ff0ed027-9ceb-4c70-b389-31eedf2e3714 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:08.344248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff0ed027-9ceb-4c70-b389-31eedf2e3714 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:08.346275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff0ed027-9ceb-4c70-b389-31eedf2e3714 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:08.346275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff0ed027-9ceb-4c70-b389-31eedf2e3714 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:08.346275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff0ed027-9ceb-4c70-b389-31eedf2e3714 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:08.370192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-090a1340-542f-4a1a-91a6-abecdb10257c tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:08.370813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-090a1340-542f-4a1a-91a6-abecdb10257c tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:08.377905 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-090a1340-542f-4a1a-91a6-abecdb10257c tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:08.378744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-090a1340-542f-4a1a-91a6-abecdb10257c tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:08.379937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-090a1340-542f-4a1a-91a6-abecdb10257c tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:08.380376 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-090a1340-542f-4a1a-91a6-abecdb10257c tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:08.504027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ff0ed027-9ceb-4c70-b389-31eedf2e3714 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:08.513565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ff0ed027-9ceb-4c70-b389-31eedf2e3714 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.186119 Jul 15 15:57:08.515017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 318/632] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:08 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:08.627064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-090a1340-542f-4a1a-91a6-abecdb10257c tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:08.641122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-090a1340-542f-4a1a-91a6-abecdb10257c tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.274870 Jul 15 15:57:08.642065 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 315/633] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:08 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:08.925789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:08.926525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:08.934412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:08.934951 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:08.935896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:08.936573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:09.042262 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-4495330a-6f2a-4e0d-b0fc-680b70d46517 req-bb994dcb-31b0-4e08-afb4-27df79ca9c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a93327-6cc1-4c7d-bf18-7ff61407d195", "name": "network-vif-plugged", "status": "completed", "tag": "8dc1ab8a-8325-4822-a448-42037a7d9e0b"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:09.051213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-4495330a-6f2a-4e0d-b0fc-680b70d46517 req-bb994dcb-31b0-4e08-afb4-27df79ca9c89 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:09.052196 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-4495330a-6f2a-4e0d-b0fc-680b70d46517 req-bb994dcb-31b0-4e08-afb4-27df79ca9c89 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:09.064702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-4495330a-6f2a-4e0d-b0fc-680b70d46517 req-bb994dcb-31b0-4e08-afb4-27df79ca9c89 service nova] Creating event network-vif-plugged:8dc1ab8a-8325-4822-a448-42037a7d9e0b for instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 on hv-cinder-83587 Jul 15 15:57:09.070214 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-4495330a-6f2a-4e0d-b0fc-680b70d46517 req-bb994dcb-31b0-4e08-afb4-27df79ca9c89 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031901 Jul 15 15:57:09.070950 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 316/634] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:57:09.331764 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:09.344327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:09.345622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:09.346793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-92af4751-6137-4d79-887b-56602bc42395 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1744 microversion: 2.20 time: 0.425697 Jul 15 15:57:09.347558 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 319/635] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:08 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1744 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:09.531516 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-52dd7eac-0b74-4b90-b6ab-83c2822bdd79 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:09.532829 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-52dd7eac-0b74-4b90-b6ab-83c2822bdd79 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:09.543371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-52dd7eac-0b74-4b90-b6ab-83c2822bdd79 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:09.543978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-52dd7eac-0b74-4b90-b6ab-83c2822bdd79 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:09.545074 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-52dd7eac-0b74-4b90-b6ab-83c2822bdd79 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:09.545632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-52dd7eac-0b74-4b90-b6ab-83c2822bdd79 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:09.658304 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e8d30ddb-414d-4e13-b2cd-75d807e3dc41 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:09.658998 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e8d30ddb-414d-4e13-b2cd-75d807e3dc41 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:09.665257 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8d30ddb-414d-4e13-b2cd-75d807e3dc41 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:09.665715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8d30ddb-414d-4e13-b2cd-75d807e3dc41 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:09.666488 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8d30ddb-414d-4e13-b2cd-75d807e3dc41 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:09.666929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8d30ddb-414d-4e13-b2cd-75d807e3dc41 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:09.816076 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e8d30ddb-414d-4e13-b2cd-75d807e3dc41 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:09.828138 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e8d30ddb-414d-4e13-b2cd-75d807e3dc41 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.173558 Jul 15 15:57:09.828896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 320/636] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:09 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:09.873918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-52dd7eac-0b74-4b90-b6ab-83c2822bdd79 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:09.884059 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-52dd7eac-0b74-4b90-b6ab-83c2822bdd79 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.357708 Jul 15 15:57:09.884930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 317/637] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:09 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:10.250314 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-775fe06d-91f8-4b00-9882-77971f81177b req-ebec5474-7a8b-428c-9aa5-0550660bb982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6e6ea2-1ab6-4817-a02f-0c32dadb97b5", "tag": "bb3cde32-0415-4bd3-afe9-b8b361cc5127"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:10.259339 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-775fe06d-91f8-4b00-9882-77971f81177b req-ebec5474-7a8b-428c-9aa5-0550660bb982 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:10.259943 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-775fe06d-91f8-4b00-9882-77971f81177b req-ebec5474-7a8b-428c-9aa5-0550660bb982 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:10.272916 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-775fe06d-91f8-4b00-9882-77971f81177b req-ebec5474-7a8b-428c-9aa5-0550660bb982 service nova] Creating event network-changed:bb3cde32-0415-4bd3-afe9-b8b361cc5127 for instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 on hv-cinder-83587 Jul 15 15:57:10.279041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-775fe06d-91f8-4b00-9882-77971f81177b req-ebec5474-7a8b-428c-9aa5-0550660bb982 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032414 Jul 15 15:57:10.279678 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 321/638] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:57:10.365600 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:10.366131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:10.372270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:10.372729 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:10.373511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:10.374129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:10.511831 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:10.519775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:10.521268 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:10.522928 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8db14e33-9f95-48e0-bb9b-68a0e3032049 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1744 microversion: 2.20 time: 0.161330 Jul 15 15:57:10.525184 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 318/639] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:10 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:10.845128 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-64fec5a2-6bd7-4482-926b-a5e832de46a7 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:10.845994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-64fec5a2-6bd7-4482-926b-a5e832de46a7 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:10.852859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64fec5a2-6bd7-4482-926b-a5e832de46a7 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:10.853312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64fec5a2-6bd7-4482-926b-a5e832de46a7 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:10.854083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64fec5a2-6bd7-4482-926b-a5e832de46a7 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:10.854520 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64fec5a2-6bd7-4482-926b-a5e832de46a7 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:10.905441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-71c29e51-5778-4955-bfc1-d264e2526962 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:10.906098 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-71c29e51-5778-4955-bfc1-d264e2526962 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:10.912984 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-71c29e51-5778-4955-bfc1-d264e2526962 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:10.916276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-71c29e51-5778-4955-bfc1-d264e2526962 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:10.916276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-71c29e51-5778-4955-bfc1-d264e2526962 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:10.916276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-71c29e51-5778-4955-bfc1-d264e2526962 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:11.006898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-64fec5a2-6bd7-4482-926b-a5e832de46a7 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:11.014936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-64fec5a2-6bd7-4482-926b-a5e832de46a7 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.174049 Jul 15 15:57:11.015975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 322/640] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:10 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:11.089443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-f1abc401-61ac-424a-8462-3f3e4c5a0a44 req-d6d45f00-2232-42e7-b38e-7318103b60df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652ce721-72c7-4314-8f15-bf94f30df443", "name": "network-vif-plugged", "status": "completed", "tag": "7734477d-4e1a-41e3-bb36-a23f41ac66aa"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:11.096192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-71c29e51-5778-4955-bfc1-d264e2526962 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:11.098473 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f1abc401-61ac-424a-8462-3f3e4c5a0a44 req-d6d45f00-2232-42e7-b38e-7318103b60df service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:11.098996 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f1abc401-61ac-424a-8462-3f3e4c5a0a44 req-d6d45f00-2232-42e7-b38e-7318103b60df service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:11.107427 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-71c29e51-5778-4955-bfc1-d264e2526962 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.209066 Jul 15 15:57:11.118035 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 319/641] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:10 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:11.118164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-f1abc401-61ac-424a-8462-3f3e4c5a0a44 req-d6d45f00-2232-42e7-b38e-7318103b60df service nova] Creating event network-vif-plugged:7734477d-4e1a-41e3-bb36-a23f41ac66aa for instance 652ce721-72c7-4314-8f15-bf94f30df443 on hv-cinder-83587 Jul 15 15:57:11.118164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-f1abc401-61ac-424a-8462-3f3e4c5a0a44 req-d6d45f00-2232-42e7-b38e-7318103b60df service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 Jul 15 15:57:11.118164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 323/642] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:57:11.542104 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:11.542768 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:11.549648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:11.550590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:11.551279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:11.551979 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:11.764672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:11.773354 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:11.774866 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:11.776072 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4feffcfb-d3f0-4de9-993b-1e228b910ca2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1744 microversion: 2.20 time: 0.238531 Jul 15 15:57:11.776645 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 320/643] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:11 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1744 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:12.032106 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d26a7733-9f49-46a4-9e10-ad89169593bf tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:12.032826 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d26a7733-9f49-46a4-9e10-ad89169593bf tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:12.040792 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d26a7733-9f49-46a4-9e10-ad89169593bf tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:12.041286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d26a7733-9f49-46a4-9e10-ad89169593bf tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:12.042131 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d26a7733-9f49-46a4-9e10-ad89169593bf tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:12.042812 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d26a7733-9f49-46a4-9e10-ad89169593bf tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:12.126297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4dacab92-5298-4f72-9b1e-dc9fc868fe61 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:12.126946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4dacab92-5298-4f72-9b1e-dc9fc868fe61 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:12.142934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4dacab92-5298-4f72-9b1e-dc9fc868fe61 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:12.149008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4dacab92-5298-4f72-9b1e-dc9fc868fe61 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:12.149883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4dacab92-5298-4f72-9b1e-dc9fc868fe61 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:12.150334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4dacab92-5298-4f72-9b1e-dc9fc868fe61 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:12.204226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d26a7733-9f49-46a4-9e10-ad89169593bf tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:12.213412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d26a7733-9f49-46a4-9e10-ad89169593bf tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1315 microversion: 2.1 time: 0.185657 Jul 15 15:57:12.219560 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 324/644] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:12 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:12.315921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4dacab92-5298-4f72-9b1e-dc9fc868fe61 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:12.325002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4dacab92-5298-4f72-9b1e-dc9fc868fe61 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.203082 Jul 15 15:57:12.330419 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 321/645] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:12 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:12.794558 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:12.795208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:12.801695 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:12.802150 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:12.802931 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:12.803389 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:12.910868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-53738775-18a5-43d2-b1ae-eb2e3c63fc35 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1507993191"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:12.911449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-53738775-18a5-43d2-b1ae-eb2e3c63fc35 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:12.917590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-53738775-18a5-43d2-b1ae-eb2e3c63fc35 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:12.918042 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-53738775-18a5-43d2-b1ae-eb2e3c63fc35 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:12.918810 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-53738775-18a5-43d2-b1ae-eb2e3c63fc35 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:12.919242 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-53738775-18a5-43d2-b1ae-eb2e3c63fc35 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:12.942400 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:12.951270 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:12.952921 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:12.954272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-16c8ba1a-d3d9-4d36-8295-6c4fac32e49f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1744 microversion: 2.20 time: 0.163798 Jul 15 15:57:12.954999 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 325/646] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:12 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:13.045769 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.network.security_group_api [None req-53738775-18a5-43d2-b1ae-eb2e3c63fc35 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Adding security group f3449546-8483-4bb1-848d-1b5d4355c636 to port bb3cde32-0415-4bd3-afe9-b8b361cc5127 Jul 15 15:57:13.230474 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-829e182d-0a37-4280-bb3d-5d78d3c6ccd1 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:13.231090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-829e182d-0a37-4280-bb3d-5d78d3c6ccd1 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:13.237964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-829e182d-0a37-4280-bb3d-5d78d3c6ccd1 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.238417 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-829e182d-0a37-4280-bb3d-5d78d3c6ccd1 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.239193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-829e182d-0a37-4280-bb3d-5d78d3c6ccd1 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.239733 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-829e182d-0a37-4280-bb3d-5d78d3c6ccd1 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.371243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-829e182d-0a37-4280-bb3d-5d78d3c6ccd1 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:13.378736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-829e182d-0a37-4280-bb3d-5d78d3c6ccd1 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1464 microversion: 2.1 time: 0.152093 Jul 15 15:57:13.379344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 326/647] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:13 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:13.384309 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ea8647fc-99fb-44c7-afc0-23093aeef898 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:13.385148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ea8647fc-99fb-44c7-afc0-23093aeef898 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:13.391482 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea8647fc-99fb-44c7-afc0-23093aeef898 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.397401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea8647fc-99fb-44c7-afc0-23093aeef898 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.397401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea8647fc-99fb-44c7-afc0-23093aeef898 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.397401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea8647fc-99fb-44c7-afc0-23093aeef898 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.470663 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-53738775-18a5-43d2-b1ae-eb2e3c63fc35 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "POST /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/action" status: 202 len: 0 microversion: 2.1 time: 0.563685 Jul 15 15:57:13.474647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 322/648] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:57:12 2022] POST /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:57:13.483794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fa8ec552-75d4-4ad3-9f20-acd7b2497a78 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:13.484290 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fa8ec552-75d4-4ad3-9f20-acd7b2497a78 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:13.492536 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fa8ec552-75d4-4ad3-9f20-acd7b2497a78 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.493041 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fa8ec552-75d4-4ad3-9f20-acd7b2497a78 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.493811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fa8ec552-75d4-4ad3-9f20-acd7b2497a78 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.494291 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fa8ec552-75d4-4ad3-9f20-acd7b2497a78 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.531897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fa8ec552-75d4-4ad3-9f20-acd7b2497a78 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:57:13.573066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ea8647fc-99fb-44c7-afc0-23093aeef898 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:13.581984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ea8647fc-99fb-44c7-afc0-23093aeef898 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.201428 Jul 15 15:57:13.582656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 327/649] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:13 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:13.588642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-292e18a8-69e6-4f14-aa7e-455f3e4eeddc req-0ff4913c-81ee-4c66-ab14-732a5e7e005d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6e6ea2-1ab6-4817-a02f-0c32dadb97b5", "tag": "bb3cde32-0415-4bd3-afe9-b8b361cc5127"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:13.598144 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-292e18a8-69e6-4f14-aa7e-455f3e4eeddc req-0ff4913c-81ee-4c66-ab14-732a5e7e005d service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.603331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-292e18a8-69e6-4f14-aa7e-455f3e4eeddc req-0ff4913c-81ee-4c66-ab14-732a5e7e005d service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.611446 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-292e18a8-69e6-4f14-aa7e-455f3e4eeddc req-0ff4913c-81ee-4c66-ab14-732a5e7e005d service nova] Creating event network-changed:bb3cde32-0415-4bd3-afe9-b8b361cc5127 for instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 on hv-cinder-83587 Jul 15 15:57:13.617892 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-292e18a8-69e6-4f14-aa7e-455f3e4eeddc req-0ff4913c-81ee-4c66-ab14-732a5e7e005d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033477 Jul 15 15:57:13.618568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 328/650] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:57:13.627904 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-325dd2a6-1fb3-4f8d-b286-69b4fce238d5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:13.628599 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-325dd2a6-1fb3-4f8d-b286-69b4fce238d5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:13.637212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-325dd2a6-1fb3-4f8d-b286-69b4fce238d5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.637673 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-325dd2a6-1fb3-4f8d-b286-69b4fce238d5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.638468 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-325dd2a6-1fb3-4f8d-b286-69b4fce238d5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.638943 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-325dd2a6-1fb3-4f8d-b286-69b4fce238d5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.796725 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-325dd2a6-1fb3-4f8d-b286-69b4fce238d5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:13.807256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-325dd2a6-1fb3-4f8d-b286-69b4fce238d5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1759 microversion: 2.1 time: 0.181903 Jul 15 15:57:13.808528 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 329/651] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:13 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:13.898356 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fa8ec552-75d4-4ad3-9f20-acd7b2497a78 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "DELETE /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 204 len: 0 microversion: 2.1 time: 0.418741 Jul 15 15:57:13.899210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 323/652] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 15:57:13 2022] DELETE /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:57:13.909279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-eabbb019-26ab-4073-ba4d-38564fdd5935 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:13.911875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-eabbb019-26ab-4073-ba4d-38564fdd5935 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:13.915924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eabbb019-26ab-4073-ba4d-38564fdd5935 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.916379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eabbb019-26ab-4073-ba4d-38564fdd5935 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.917149 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eabbb019-26ab-4073-ba4d-38564fdd5935 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.917582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eabbb019-26ab-4073-ba4d-38564fdd5935 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.978564 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:13.979511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:13.986260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.986941 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:13.987877 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:13.988463 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:14.109955 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eabbb019-26ab-4073-ba4d-38564fdd5935 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:14.125333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-eabbb019-26ab-4073-ba4d-38564fdd5935 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1470 microversion: 2.1 time: 0.219811 Jul 15 15:57:14.126153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 330/653] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:13 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:14.237350 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:14.245511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:14.247002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:14.253410 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c721493b-6eb7-48f5-9bf1-6de1e19f9282 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1744 microversion: 2.20 time: 0.277746 Jul 15 15:57:14.253410 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 324/654] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:13 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1744 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:14.599942 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4ce17366-f5e3-43e3-a1a4-5a6d1be1a57d tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:14.600591 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4ce17366-f5e3-43e3-a1a4-5a6d1be1a57d tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:14.607099 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4ce17366-f5e3-43e3-a1a4-5a6d1be1a57d tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:14.607583 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4ce17366-f5e3-43e3-a1a4-5a6d1be1a57d tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:14.608361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4ce17366-f5e3-43e3-a1a4-5a6d1be1a57d tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:14.608804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4ce17366-f5e3-43e3-a1a4-5a6d1be1a57d tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:14.734357 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4ce17366-f5e3-43e3-a1a4-5a6d1be1a57d tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:14.742310 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4ce17366-f5e3-43e3-a1a4-5a6d1be1a57d tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.146502 Jul 15 15:57:14.742880 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 331/655] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:14 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:15.142392 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a0e99cc8-bc8c-46f1-9d8f-78b91ba94819 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:15.143014 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a0e99cc8-bc8c-46f1-9d8f-78b91ba94819 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:15.150293 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0e99cc8-bc8c-46f1-9d8f-78b91ba94819 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:15.150748 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0e99cc8-bc8c-46f1-9d8f-78b91ba94819 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:15.151562 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0e99cc8-bc8c-46f1-9d8f-78b91ba94819 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:15.152002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0e99cc8-bc8c-46f1-9d8f-78b91ba94819 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:15.266136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:15.266921 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:15.273503 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:15.273955 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:15.274723 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:15.275157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:15.283909 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a0e99cc8-bc8c-46f1-9d8f-78b91ba94819 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:15.293651 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a0e99cc8-bc8c-46f1-9d8f-78b91ba94819 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1470 microversion: 2.1 time: 0.154069 Jul 15 15:57:15.299366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 325/656] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:15 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:15.404155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:15.412038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:15.413546 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:15.414685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8d830314-471b-402f-8124-4dd6c40756e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.152417 Jul 15 15:57:15.415240 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 332/657] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:15 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:57:15.759925 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-21a88580-cc50-4c1e-8e30-21ffb5bf89f4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:15.760549 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-21a88580-cc50-4c1e-8e30-21ffb5bf89f4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:15.766507 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21a88580-cc50-4c1e-8e30-21ffb5bf89f4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:15.766962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21a88580-cc50-4c1e-8e30-21ffb5bf89f4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:15.767789 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21a88580-cc50-4c1e-8e30-21ffb5bf89f4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:15.768233 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21a88580-cc50-4c1e-8e30-21ffb5bf89f4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:15.903002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-21a88580-cc50-4c1e-8e30-21ffb5bf89f4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:15.910998 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-21a88580-cc50-4c1e-8e30-21ffb5bf89f4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.155610 Jul 15 15:57:15.918648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 326/658] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:15 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:16.312809 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6e81244f-52c8-491d-8980-e08775a9fc8d tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:16.313454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6e81244f-52c8-491d-8980-e08775a9fc8d tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:16.320541 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e81244f-52c8-491d-8980-e08775a9fc8d tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:16.320988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e81244f-52c8-491d-8980-e08775a9fc8d tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:16.321760 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e81244f-52c8-491d-8980-e08775a9fc8d tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:16.322197 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e81244f-52c8-491d-8980-e08775a9fc8d tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:16.433751 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:16.434358 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:16.436787 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:16.441564 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:16.442100 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:16.448468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:16.448468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:16.459450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6e81244f-52c8-491d-8980-e08775a9fc8d tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:16.462534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:16.467695 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6e81244f-52c8-491d-8980-e08775a9fc8d tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1470 microversion: 2.1 time: 0.158623 Jul 15 15:57:16.468278 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 333/659] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:16 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:16.579191 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:16.587737 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:16.589824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:16.591057 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4817ac9b-1c89-4fa1-b85d-a2de54224df3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.161197 Jul 15 15:57:16.591684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 327/660] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:16 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:57:16.929574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-623bfae4-b0db-4b4d-9cc3-ff5095f0ce7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:16.930178 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-623bfae4-b0db-4b4d-9cc3-ff5095f0ce7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:16.937297 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-623bfae4-b0db-4b4d-9cc3-ff5095f0ce7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:16.937769 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-623bfae4-b0db-4b4d-9cc3-ff5095f0ce7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:16.938567 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-623bfae4-b0db-4b4d-9cc3-ff5095f0ce7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:16.939012 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-623bfae4-b0db-4b4d-9cc3-ff5095f0ce7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:17.096679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-623bfae4-b0db-4b4d-9cc3-ff5095f0ce7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:17.106467 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-623bfae4-b0db-4b4d-9cc3-ff5095f0ce7a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1722 microversion: 2.1 time: 0.181166 Jul 15 15:57:17.107050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 334/661] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:16 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:17.485231 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bd44bdbd-d4a8-47ae-a528-a0cca5962aed tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:17.486590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bd44bdbd-d4a8-47ae-a528-a0cca5962aed tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:17.496150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd44bdbd-d4a8-47ae-a528-a0cca5962aed tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:17.496936 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd44bdbd-d4a8-47ae-a528-a0cca5962aed tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:17.497921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd44bdbd-d4a8-47ae-a528-a0cca5962aed tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:17.498556 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd44bdbd-d4a8-47ae-a528-a0cca5962aed tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:17.611387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:17.612729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:17.620386 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:17.621131 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:17.622135 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:17.622824 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:17.717319 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bd44bdbd-d4a8-47ae-a528-a0cca5962aed tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:17.727225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bd44bdbd-d4a8-47ae-a528-a0cca5962aed tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1470 microversion: 2.1 time: 0.246640 Jul 15 15:57:17.748616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 328/662] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:17 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:17.814034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-8cc2fdac-587a-4efe-a5f3-bd1ad3dd8d3c req-be12810d-5da5-4952-87e2-24e364ade074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a93327-6cc1-4c7d-bf18-7ff61407d195", "name": "network-vif-deleted", "tag": "8dc1ab8a-8325-4822-a448-42037a7d9e0b"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:17.827345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-8cc2fdac-587a-4efe-a5f3-bd1ad3dd8d3c req-be12810d-5da5-4952-87e2-24e364ade074 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:17.828022 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-8cc2fdac-587a-4efe-a5f3-bd1ad3dd8d3c req-be12810d-5da5-4952-87e2-24e364ade074 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:17.852499 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-8cc2fdac-587a-4efe-a5f3-bd1ad3dd8d3c req-be12810d-5da5-4952-87e2-24e364ade074 service nova] Creating event network-vif-deleted:8dc1ab8a-8325-4822-a448-42037a7d9e0b for instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 on hv-cinder-83587 Jul 15 15:57:17.870759 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-8cc2fdac-587a-4efe-a5f3-bd1ad3dd8d3c req-be12810d-5da5-4952-87e2-24e364ade074 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063705 Jul 15 15:57:17.870759 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 329/663] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:57:17.960526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:17.972776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:17.978063 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:17.979335 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9fb964d7-6f68-4b37-a1ad-86a04b129b68 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.373637 Jul 15 15:57:17.980223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 335/664] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:17 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:18.124582 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-060e20b3-6dea-424f-8d5e-1bbee8ad52da tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:18.127619 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-060e20b3-6dea-424f-8d5e-1bbee8ad52da tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:18.141522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-060e20b3-6dea-424f-8d5e-1bbee8ad52da tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:18.142260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-060e20b3-6dea-424f-8d5e-1bbee8ad52da tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:18.143133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-060e20b3-6dea-424f-8d5e-1bbee8ad52da tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:18.143713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-060e20b3-6dea-424f-8d5e-1bbee8ad52da tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:18.311607 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-060e20b3-6dea-424f-8d5e-1bbee8ad52da tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:18.322012 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-060e20b3-6dea-424f-8d5e-1bbee8ad52da tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1699 microversion: 2.1 time: 0.201766 Jul 15 15:57:18.322809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 330/665] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:18 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1699 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:18.343243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9b4c13b2-3de7-4fd8-ba50-fde94a16fd2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:18.353011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9b4c13b2-3de7-4fd8-ba50-fde94a16fd2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:18.357823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9b4c13b2-3de7-4fd8-ba50-fde94a16fd2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:18.411630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:18.448953 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9b4c13b2-3de7-4fd8-ba50-fde94a16fd2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Going to try to start instance {{(pid=130091) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 15:57:18.696148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9b4c13b2-3de7-4fd8-ba50-fde94a16fd2b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/action" status: 202 len: 0 microversion: 2.1 time: 0.360415 Jul 15 15:57:18.700047 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 336/666] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:57:18 2022] POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:57:18.705585 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-878b5cd4-35d1-49b3-b206-2ccc578ad9e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:18.706905 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-878b5cd4-35d1-49b3-b206-2ccc578ad9e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:18.713955 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-878b5cd4-35d1-49b3-b206-2ccc578ad9e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:18.714412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-878b5cd4-35d1-49b3-b206-2ccc578ad9e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:18.715195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-878b5cd4-35d1-49b3-b206-2ccc578ad9e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:18.715658 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-878b5cd4-35d1-49b3-b206-2ccc578ad9e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:18.748108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:18.752031 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:18.761004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:18.761944 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:18.763915 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:18.764772 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:18.800997 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:18.812915 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:18.813539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:18.815333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lazy-loading 'fault' on Instance uuid 28a93327-6cc1-4c7d-bf18-7ff61407d195 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:57:18.908868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e02c61bdce42ab9ffff539b231ecc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dce4132ee48c7879319206fcee635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:18.929655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8320d5fb-5404-40fd-935b-988462782079 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 200 len: 1305 microversion: 2.1 time: 0.186221 Jul 15 15:57:18.937534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-878b5cd4-35d1-49b3-b206-2ccc578ad9e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:18.941058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 337/667] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:18 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 1305 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:18.945875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-878b5cd4-35d1-49b3-b206-2ccc578ad9e6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1708 microversion: 2.1 time: 0.244434 Jul 15 15:57:18.951015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 331/668] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:18 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1708 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:57:19.009496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:19.010505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:19.019180 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:19.032027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:19.033194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:19.033899 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:19.334603 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:19.348619 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:19.350660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:19.351879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-65f39516-85e5-41db-b5eb-d6c8281477cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.346359 Jul 15 15:57:19.371451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 338/669] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:19 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:19.949608 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:19.951088 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] [instance: 28a93327-6cc1-4c7d-bf18-7ff61407d195] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:19.958628 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:19.959431 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:19.960792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:19.961955 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:19.966605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-327a243e-17cd-4795-8e2a-47c592c0ee44 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:19.967319 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-327a243e-17cd-4795-8e2a-47c592c0ee44 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:19.974031 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-327a243e-17cd-4795-8e2a-47c592c0ee44 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:19.977490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-327a243e-17cd-4795-8e2a-47c592c0ee44 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:19.981282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-327a243e-17cd-4795-8e2a-47c592c0ee44 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:19.981282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-327a243e-17cd-4795-8e2a-47c592c0ee44 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:19.981974 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] HTTP exception thrown: Instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 could not be found. Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Request method failure captured: Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 HTTP/1.1 Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y5BU_UX3yo-vhsnkOZmAL-ljOoryaJFp4IZWElFl6oaxF1oxLwp8iJack8P_l81ItASXb05q7uD_p_zhrAaLzfBnD5Lnlg1-edIT_LOAPXTbjEAnrpHdoe0CNQNxBver6qZDo5YrNi0UnfFH17evUYOVfmGC6eHSeIYftyTNd4SrPs Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 3f2dce4132ee48c7879319206fcee635 Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-VolumesNegativeTest-1899362062 Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 15:57:19.984685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/3f2dce4132ee48c7879319206fcee635"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_3f2dce4132ee48c7879319206fcee635"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/3f2dce4132ee48c7879319206fcee635"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/3f2dce4132ee48c7879319206fcee635"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-VolumesNegativeTest-1899362062 Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 3f2dce4132ee48c7879319206fcee635 Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-VolumesNegativeTest-1899362062 Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-VolumesNegativeTest-1899362062-project Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: a9e02c61bdce42ab9ffff539b231ecc7 Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-VolumesNegativeTest-1899362062-project Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 could not be found. Jul 15 15:57:19.986209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '28a93327-6cc1-4c7d-bf18-7ff61407d195'} Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 could not be found. Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:57:19.986976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 could not be found. Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 could not be found. Jul 15 15:57:19.988216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 15:57:19.991454 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] Returning 404 to user: Instance 28a93327-6cc1-4c7d-bf18-7ff61407d195 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:57:19.992576 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dd66fed1-ff65-43a2-a6cf-0be7a5ca2422 tempest-VolumesNegativeTest-1899362062 tempest-VolumesNegativeTest-1899362062-project] 10.222.0.98 "GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195" status: 404 len: 111 microversion: 2.1 time: 0.046922 Jul 15 15:57:19.993937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 332/670] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:19 2022] GET /compute/v2.1/servers/28a93327-6cc1-4c7d-bf18-7ff61407d195 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:57:20.133862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-327a243e-17cd-4795-8e2a-47c592c0ee44 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:20.137679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-327a243e-17cd-4795-8e2a-47c592c0ee44 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1708 microversion: 2.1 time: 0.175098 Jul 15 15:57:20.138251 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 339/671] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:19 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1708 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:20.382856 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:20.383420 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:20.389516 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:20.389965 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:20.390826 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:20.391264 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:20.527031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:20.535283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:20.537060 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:20.538082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-29b299d4-fe0b-4204-8d22-81ad86a42155 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.159991 Jul 15 15:57:20.538633 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 333/672] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:20 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:21.155630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8d6c35ca-7fd5-44b6-874e-310d5db5d610 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:21.156928 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8d6c35ca-7fd5-44b6-874e-310d5db5d610 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:21.164783 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d6c35ca-7fd5-44b6-874e-310d5db5d610 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:21.165236 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d6c35ca-7fd5-44b6-874e-310d5db5d610 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:21.166055 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d6c35ca-7fd5-44b6-874e-310d5db5d610 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:21.166493 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d6c35ca-7fd5-44b6-874e-310d5db5d610 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:21.320656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8d6c35ca-7fd5-44b6-874e-310d5db5d610 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:21.330924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8d6c35ca-7fd5-44b6-874e-310d5db5d610 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1712 microversion: 2.1 time: 0.179191 Jul 15 15:57:21.342149 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 340/673] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:57:21 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1712 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:57:21.556185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:21.557395 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:21.564234 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:21.564907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:21.565873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:21.566321 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:21.733569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:21.742750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:21.744446 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:21.745738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e70c1a86-d801-4dfa-83ee-be3321e682e1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.193415 Jul 15 15:57:21.751472 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 334/674] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:21 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:22.764626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:22.765902 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:22.773030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:22.774566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:22.774566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:22.774844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:22.914282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:22.922550 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:22.924295 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:22.925603 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2b0e9a77-689a-4956-ab72-47e42bdae756 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.164912 Jul 15 15:57:22.927331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 341/675] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:22 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:23.944783 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:23.945554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:23.953015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:23.953611 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:23.954535 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:23.955085 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:24.114304 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:24.127815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:24.129604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:24.131458 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7fa2ac2f-0555-4450-b4f8-461995b56db1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.191186 Jul 15 15:57:24.132371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 335/676] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:23 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:25.157138 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:25.157985 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:25.165415 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:25.166160 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:25.167142 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:25.167664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:25.374628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:25.390406 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:25.392354 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:25.394102 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a094e7b7-8e1b-4675-a8e6-dc5c7356e0cd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.243022 Jul 15 15:57:25.405932 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 342/677] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:25 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:26.413276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:26.413903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:26.421273 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:26.421736 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:26.422534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:26.422977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:26.574484 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:26.582355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:26.584687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:26.585857 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f2b313c1-3d33-483e-a137-d0563738e6d5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.176624 Jul 15 15:57:26.586696 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 336/678] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:26 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:27.606685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:27.608379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:27.619502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:27.620324 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:27.621566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:27.622219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:27.780839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:27.790898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:27.792763 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:27.793933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9defc778-a0bb-40ce-bce4-691f515adcaa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.191835 Jul 15 15:57:27.794968 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 343/679] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:27 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:57:28.812660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:28.813219 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:28.819725 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:28.820167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:28.820922 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:28.821357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:28.946220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:28.954068 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:28.955606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:28.956760 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-280d89e3-62c8-47c8-90ec-89b3c1dc8377 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1739 microversion: 2.20 time: 0.148071 Jul 15 15:57:28.957324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 337/680] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:28 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1739 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:57:29.975099 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:29.975749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:29.982446 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:29.982894 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:29.983683 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:29.984113 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:30.125947 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:30.134563 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:30.136326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:30.138203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-eb45375e-26bd-4dfb-a8fc-e12cf75e09fa tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1721 microversion: 2.20 time: 0.166978 Jul 15 15:57:30.138766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 344/681] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:29 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:31.156504 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:31.157298 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:31.164188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:31.164641 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:31.165420 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:31.165853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:31.302470 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:31.310412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:31.311958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:31.313507 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bcdd95ad-0bcf-40bd-a53d-ceee0cc38093 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1721 microversion: 2.20 time: 0.160575 Jul 15 15:57:31.313680 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 338/682] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:31 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:32.331397 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:32.332004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:32.338784 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:32.339230 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:32.340023 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:32.340451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:32.474210 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:32.482642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:32.484169 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:32.485379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7f9b7e75-8f27-42c1-a002-503165271bab tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1721 microversion: 2.20 time: 0.157827 Jul 15 15:57:32.485902 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 345/683] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:32 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:32.944594 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-73708003-c366-4887-a609-b0959207ab57 req-a9cc862c-19d9-42e8-b14b-7ffdc8e746ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652ce721-72c7-4314-8f15-bf94f30df443", "name": "network-vif-unplugged", "status": "completed", "tag": "7734477d-4e1a-41e3-bb36-a23f41ac66aa"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:32.953803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-73708003-c366-4887-a609-b0959207ab57 req-a9cc862c-19d9-42e8-b14b-7ffdc8e746ab service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:32.954247 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-73708003-c366-4887-a609-b0959207ab57 req-a9cc862c-19d9-42e8-b14b-7ffdc8e746ab service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:32.965574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-73708003-c366-4887-a609-b0959207ab57 req-a9cc862c-19d9-42e8-b14b-7ffdc8e746ab service nova] Creating event network-vif-unplugged:7734477d-4e1a-41e3-bb36-a23f41ac66aa for instance 652ce721-72c7-4314-8f15-bf94f30df443 on hv-cinder-83587 Jul 15 15:57:32.970557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-73708003-c366-4887-a609-b0959207ab57 req-a9cc862c-19d9-42e8-b14b-7ffdc8e746ab service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030294 Jul 15 15:57:32.971153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 339/684] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:57:33.503937 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:33.504544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:33.511050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:33.511535 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:33.512296 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:33.512732 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:33.642857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:33.652302 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:33.653800 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:33.654996 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-507f352b-299a-4cf1-8dba-aa4caf8d4920 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1664 microversion: 2.20 time: 0.154836 Jul 15 15:57:33.655559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 346/685] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:33 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:33.674106 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1c421558-4e35-428a-a7b7-88fe80b90086 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5573a7a6-8722-4e21-ab9e-a0b27ed7b751"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:33.675239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1c421558-4e35-428a-a7b7-88fe80b90086 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:33.681439 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1c421558-4e35-428a-a7b7-88fe80b90086 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:33.681882 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1c421558-4e35-428a-a7b7-88fe80b90086 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:33.682637 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1c421558-4e35-428a-a7b7-88fe80b90086 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:33.683064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1c421558-4e35-428a-a7b7-88fe80b90086 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:34.751637 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1c421558-4e35-428a-a7b7-88fe80b90086 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.081678 Jul 15 15:57:34.752270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 340/686] 10.222.0.98 () {62 vars in 1363 bytes} [Fri Jul 15 15:57:33 2022] POST /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments => generated 188 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:57:34.865969 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2a225c69-09c4-427a-bb87-ce8e51913d46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:57:34.866533 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2a225c69-09c4-427a-bb87-ce8e51913d46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:34.872959 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a225c69-09c4-427a-bb87-ce8e51913d46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:34.873405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a225c69-09c4-427a-bb87-ce8e51913d46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:34.874168 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a225c69-09c4-427a-bb87-ce8e51913d46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:34.874611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a225c69-09c4-427a-bb87-ce8e51913d46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:35.109316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2a225c69-09c4-427a-bb87-ce8e51913d46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/action" status: 202 len: 0 microversion: 2.20 time: 0.247790 Jul 15 15:57:35.110098 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 347/687] 10.222.0.98 () {62 vars in 1318 bytes} [Fri Jul 15 15:57:34 2022] POST /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:57:35.118333 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:35.119205 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:35.126062 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:35.126507 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:35.127269 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:35.127741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:35.258826 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:35.267468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:35.271198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:35.271198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-54312a4f-bc1f-4e6e-9272-6997f318ac84 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1750 microversion: 2.20 time: 0.155983 Jul 15 15:57:35.271447 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 341/688] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:35 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:36.290915 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:36.291481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:36.297942 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:36.298393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:36.299173 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:36.299681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:36.446127 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:36.454733 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:36.456293 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:36.457447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5e50bfc2-dc85-4dab-808b-07bbfeadca4d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1750 microversion: 2.20 time: 0.172231 Jul 15 15:57:36.458283 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 348/689] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:36 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:37.475911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:37.476530 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:37.483064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:37.483554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:37.484351 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:37.484821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:37.615467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:37.624372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:37.625847 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:37.626991 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8473fc28-0388-496b-bf0b-a15e49e194c3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1752 microversion: 2.20 time: 0.154993 Jul 15 15:57:37.627612 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 342/690] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:37 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:38.648269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:38.648900 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:38.655400 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:38.655850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:38.657192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:38.657192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:38.788753 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:38.797186 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:38.801850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:38.801850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d2f2656d-139d-49ba-b718-2b3b7f1320a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1752 microversion: 2.20 time: 0.155629 Jul 15 15:57:38.801850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 349/691] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:38 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:39.817955 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:39.818645 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:39.825852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:39.826310 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:39.827136 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:39.827596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:39.845430 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:39.957254 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:39.965936 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:39.967445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:39.968610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4266f173-faa0-4344-9107-a084ab580373 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.154592 Jul 15 15:57:39.969165 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 343/692] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:39 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:41.001433 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:41.002996 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:41.011125 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:41.011977 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:41.013280 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:41.013944 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:41.034628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:41.152173 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:41.161481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:41.163227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:41.165002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-406b3ea2-a684-44ef-a1e3-8709db2c955a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.168012 Jul 15 15:57:41.165568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 350/693] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:40 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:42.182617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:42.183380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:42.196451 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:42.197061 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:42.197869 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:42.203745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:42.349857 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:42.358296 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:42.359868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:42.361023 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a45a8d7d-8fdf-4e3d-97db-d89223e4417a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.182992 Jul 15 15:57:42.361603 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 344/694] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:42 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:57:43.381101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:43.381888 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:43.399572 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:43.400026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:43.400810 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:43.401252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:43.540823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:43.549925 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:43.551979 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:43.552693 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c59be2f8-5c2d-455e-9866-9c0d6e91c9d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.177404 Jul 15 15:57:43.559933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 351/695] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:43 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:44.570809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:44.571498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:44.578122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:44.578573 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:44.579368 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:44.579815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:44.713456 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:44.723266 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:44.725037 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:44.727235 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2d4627a4-754a-40d5-a537-1d0d04d6282b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.159573 Jul 15 15:57:44.728101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 345/696] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:44 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:45.746512 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:45.747273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:45.753933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:45.754378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:45.755173 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:45.755635 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:45.888029 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:45.896607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:45.898450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:45.899956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b9851006-ad3c-4d90-b18c-5657829bbb1b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.157988 Jul 15 15:57:45.901116 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 352/697] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:45 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:46.919472 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:46.920216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:46.930293 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:46.930293 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:46.931841 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:46.932306 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:47.068753 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:47.079971 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:47.080646 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:47.081834 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7cced3bb-6e39-4458-943b-03d1dd59c25d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.166968 Jul 15 15:57:47.082403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 346/698] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:46 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:48.101534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:48.102957 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:48.109898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:48.110668 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:48.111692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:48.112462 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:48.246473 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:48.255708 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:48.260071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:48.261965 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-039d5695-83ba-4139-9374-5e8aae9292e3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.164399 Jul 15 15:57:48.263752 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 353/699] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:48 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:49.282356 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:49.283237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:49.285476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=40 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:49.290740 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:49.291194 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:49.292016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:49.292452 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:49.429952 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:49.440032 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:49.441545 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:49.442753 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b0cff7a1-da36-4a27-8e23-a81b2d0bea25 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.164913 Jul 15 15:57:49.443509 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 347/700] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:49 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:50.462261 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:50.462870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:50.465227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=36 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:57:50.470253 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:50.472019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:50.472019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:50.472019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:50.617617 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:50.635817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:50.637624 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:50.639123 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1d53185c-2f26-4cb3-8668-6df3a534972b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.181650 Jul 15 15:57:50.640272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 354/701] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:50 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:51.666273 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:51.666895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:51.673790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:51.674237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:51.675012 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:51.675478 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:51.807611 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:51.817222 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:51.818923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:51.820638 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-061abd04-8e23-4a34-a259-33a1f662fe4f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.158930 Jul 15 15:57:51.821206 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 348/702] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:51 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:52.839362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:52.839976 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:52.846542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:52.846994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:52.847796 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:52.848239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:52.978218 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:52.986695 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:52.988222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:52.989378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-89081ccf-a46c-40b0-9b15-3c2b0ac81839 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.154711 Jul 15 15:57:52.989939 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 355/703] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:52 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:54.007928 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:54.008537 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:54.015003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:54.015491 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:54.016256 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:54.016692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:54.148667 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:54.157543 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:54.159029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:54.160221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bb8f667a-b4d2-489b-852f-174ae4ca816d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.156209 Jul 15 15:57:54.160791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 349/704] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:54 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:55.178081 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:55.179497 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:55.186096 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:55.186549 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:55.187338 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:55.187782 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:55.317850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:55.327038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:55.328584 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:55.329869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6dd4a110-c1a9-4b58-a569-fb7b521d2677 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.155644 Jul 15 15:57:55.330952 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 356/705] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:55 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:56.349623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:56.350238 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:56.356850 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:56.357301 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:56.358067 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:56.358502 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:56.492592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:56.500910 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:56.502416 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:56.503595 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dd572ddb-72a8-493d-a2b5-8911b86d5ddf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.157837 Jul 15 15:57:56.504163 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 350/706] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:56 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:57:57.522193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:57.523359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:57.529578 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:57.530020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:57.530778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:57.531207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:57.666418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:57.675129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:57.676664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:57.677825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-360c9baa-0bc3-488d-9f8e-dc42778cf096 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.159494 Jul 15 15:57:57.678389 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 357/707] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:57 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:58.700524 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:58.701579 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:58.709220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:58.709662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:58.711366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:58.711863 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:58.845857 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:58.854809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:58.856338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:57:58.857498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-791deace-ca61-46c1-aca4-5a670af81490 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.164642 Jul 15 15:57:58.858058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 351/708] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:58 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:57:59.877344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:57:59.877953 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:57:59.884727 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:59.885179 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:57:59.885954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:57:59.886390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:00.014763 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:00.023859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:00.029630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:00.029630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-64d83014-d88a-4f77-862a-645f4ead9a83 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.153110 Jul 15 15:58:00.029630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 358/709] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:57:59 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:01.045282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:01.045911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:01.053546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:01.053546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:01.053792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:01.054691 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:01.191317 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:01.200006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:01.201500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:01.202662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-48b08f2b-1ca8-405e-9a29-3073230aba1e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.161342 Jul 15 15:58:01.203234 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 352/710] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:01 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:02.221917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:02.222515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:02.229102 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:02.229555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:02.230362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:02.230828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:02.362653 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:02.371733 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:02.373217 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:02.374372 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-14e79b0f-6125-4e06-bb5f-c1b62ee8327e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.156584 Jul 15 15:58:02.374931 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 359/711] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:02 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:03.392575 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:03.393178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:03.399637 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:03.404198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:03.404198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:03.404198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:03.532239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:03.541191 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:03.542675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:03.543894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d720dc91-e26e-4b06-8cda-e4f81f536346 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.155193 Jul 15 15:58:03.544446 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 353/712] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:03 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:04.561728 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:04.562334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:04.569066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:04.570122 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:04.570891 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:04.571350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:04.699821 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:04.708457 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:04.712924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:04.712924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-de2d8bfa-0699-4150-99b7-fa880afabfb1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.153540 Jul 15 15:58:04.712924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 360/713] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:04 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:05.730048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:05.730662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:05.737475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:05.738037 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:05.738809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:05.739242 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:05.872507 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:05.880989 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:05.883078 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:05.884271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-62050ddc-0c87-46ad-8ff7-d94906b2c70c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.158154 Jul 15 15:58:05.884841 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 354/714] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:05 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:06.901524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:06.902136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:06.908820 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:06.909277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:06.910055 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:06.910499 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:07.041830 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:07.050457 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:07.051990 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:07.053193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-56fad5c7-f420-473c-ab9a-a802af6a3c8a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.155550 Jul 15 15:58:07.054338 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 361/715] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:06 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:07.061418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-bc2f444d-63e6-4c9c-9346-880e3a5baf4d req-f1b61dbb-37ce-4224-b0ba-d6764cef8825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652ce721-72c7-4314-8f15-bf94f30df443", "name": "network-vif-plugged", "status": "completed", "tag": "7734477d-4e1a-41e3-bb36-a23f41ac66aa"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:58:07.070416 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-bc2f444d-63e6-4c9c-9346-880e3a5baf4d req-f1b61dbb-37ce-4224-b0ba-d6764cef8825 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:07.070911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-bc2f444d-63e6-4c9c-9346-880e3a5baf4d req-f1b61dbb-37ce-4224-b0ba-d6764cef8825 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:07.083758 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-bc2f444d-63e6-4c9c-9346-880e3a5baf4d req-f1b61dbb-37ce-4224-b0ba-d6764cef8825 service nova] Creating event network-vif-plugged:7734477d-4e1a-41e3-bb36-a23f41ac66aa for instance 652ce721-72c7-4314-8f15-bf94f30df443 on hv-cinder-83587 Jul 15 15:58:07.089043 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-bc2f444d-63e6-4c9c-9346-880e3a5baf4d req-f1b61dbb-37ce-4224-b0ba-d6764cef8825 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031276 Jul 15 15:58:07.089713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 355/716] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:58:08.072019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:08.072652 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:08.079069 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:08.079542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:08.080334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:08.080874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:08.213673 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:08.221994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:08.223523 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:08.224671 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-31576969-eb05-4b1c-b585-0b62442c31e7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.156605 Jul 15 15:58:08.225232 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 362/717] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:08 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:09.244394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:09.245102 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:09.251344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:09.251802 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:09.252568 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:09.253008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:09.388161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:09.396488 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:09.398612 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:09.399879 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4fea6a4c-1d90-4f47-91e5-d58d1911d722 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.160311 Jul 15 15:58:09.400441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 356/718] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:09 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:10.418240 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:10.418881 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:10.425694 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:10.426152 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:10.426929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:10.427398 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:10.571934 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:10.580651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:10.582188 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:10.583544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-113653d1-3317-483c-97d8-db60f562816a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1808 microversion: 2.20 time: 0.169718 Jul 15 15:58:10.588016 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 363/719] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:10 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:11.602323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:11.602933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:11.609473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:11.609919 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:11.610675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:11.611106 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:11.742046 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:11.747162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:11.748725 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:11.749922 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7a47e202-3656-45fe-ba78-ef648a9cc2ef tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1795 microversion: 2.20 time: 0.151947 Jul 15 15:58:11.750481 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 357/720] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:58:11 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:58:28.484242 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:58:28.484902 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 15:58:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:58:30.544039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f2ec131d-9d5a-490a-a473-2c962161be64 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:30.544691 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f2ec131d-9d5a-490a-a473-2c962161be64 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:30.546629 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=19 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:58:30.547306 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=80 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:58:30.552926 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2ec131d-9d5a-490a-a473-2c962161be64 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:30.552926 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2ec131d-9d5a-490a-a473-2c962161be64 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:30.553243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2ec131d-9d5a-490a-a473-2c962161be64 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:30.553679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2ec131d-9d5a-490a-a473-2c962161be64 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:30.578431 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f2ec131d-9d5a-490a-a473-2c962161be64 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/ips" status: 200 len: 147 microversion: 2.1 time: 0.039790 Jul 15 15:58:30.578986 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 364/721] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 15:58:30 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:58:30.663714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:58:30.663857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 15:58:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:58:31.115482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:58:31.115998 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 15:58:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:58:33.469436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=21 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:58:33.470174 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=82 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:58:33.574235 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2b2cf733-9948-48c2-ba1c-4862135be5b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b57fddf-62d5-4a6f-aea4-05cb6694e915"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:58:33.575525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2b2cf733-9948-48c2-ba1c-4862135be5b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:33.577701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-16a120fa-2ce7-4bfa-82fa-5d8cac8cf467 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:58:33.578842 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-16a120fa-2ce7-4bfa-82fa-5d8cac8cf467 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:33.582886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b2cf733-9948-48c2-ba1c-4862135be5b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:33.583441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b2cf733-9948-48c2-ba1c-4862135be5b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:33.584230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b2cf733-9948-48c2-ba1c-4862135be5b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:33.584672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b2cf733-9948-48c2-ba1c-4862135be5b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:33.587875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16a120fa-2ce7-4bfa-82fa-5d8cac8cf467 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:33.588331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16a120fa-2ce7-4bfa-82fa-5d8cac8cf467 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:33.589109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16a120fa-2ce7-4bfa-82fa-5d8cac8cf467 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:33.589547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16a120fa-2ce7-4bfa-82fa-5d8cac8cf467 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:34.680463 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-16a120fa-2ce7-4bfa-82fa-5d8cac8cf467 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.106709 Jul 15 15:58:34.681238 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 365/722] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 15:58:33 2022] POST /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments => generated 194 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:58:34.709804 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2b2cf733-9948-48c2-ba1c-4862135be5b2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.244791 Jul 15 15:58:34.711236 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 358/723] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 15:58:33 2022] POST /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments => generated 194 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:58:39.408785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-15721ffe-c0ec-4315-bf0b-7e8dad70e962 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:58:39.409360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-15721ffe-c0ec-4315-bf0b-7e8dad70e962 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:39.415674 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-15721ffe-c0ec-4315-bf0b-7e8dad70e962 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:39.416128 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-15721ffe-c0ec-4315-bf0b-7e8dad70e962 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:39.416894 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-15721ffe-c0ec-4315-bf0b-7e8dad70e962 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:39.417332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-15721ffe-c0ec-4315-bf0b-7e8dad70e962 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:39.635089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-15721ffe-c0ec-4315-bf0b-7e8dad70e962 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "POST /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/action" status: 202 len: 0 microversion: 2.1 time: 0.230826 Jul 15 15:58:39.635759 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 366/724] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:58:39 2022] POST /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:58:39.647425 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-12eeddaf-bec0-46f6-b8f8-428b92cc63bc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:39.648150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-12eeddaf-bec0-46f6-b8f8-428b92cc63bc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:39.654921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-12eeddaf-bec0-46f6-b8f8-428b92cc63bc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:39.655434 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-12eeddaf-bec0-46f6-b8f8-428b92cc63bc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:39.656211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-12eeddaf-bec0-46f6-b8f8-428b92cc63bc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:39.656646 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-12eeddaf-bec0-46f6-b8f8-428b92cc63bc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:39.814193 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-12eeddaf-bec0-46f6-b8f8-428b92cc63bc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:39.822774 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-12eeddaf-bec0-46f6-b8f8-428b92cc63bc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1751 microversion: 2.1 time: 0.181718 Jul 15 15:58:39.823353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 359/725] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:39 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:40.841860 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-59e967df-1127-4d77-8ca6-77c37b1a4bc5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:40.842560 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-59e967df-1127-4d77-8ca6-77c37b1a4bc5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:40.848736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-59e967df-1127-4d77-8ca6-77c37b1a4bc5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:40.849190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-59e967df-1127-4d77-8ca6-77c37b1a4bc5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:40.849959 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-59e967df-1127-4d77-8ca6-77c37b1a4bc5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:40.850406 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-59e967df-1127-4d77-8ca6-77c37b1a4bc5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:40.998793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-59e967df-1127-4d77-8ca6-77c37b1a4bc5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:41.008897 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-59e967df-1127-4d77-8ca6-77c37b1a4bc5 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.172199 Jul 15 15:58:41.009981 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 367/726] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:40 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:41.320734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a2a5737d-824a-4f8b-ac60-de745ca91a33 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:41.321223 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a2a5737d-824a-4f8b-ac60-de745ca91a33 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:41.327889 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a2a5737d-824a-4f8b-ac60-de745ca91a33 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:41.328339 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a2a5737d-824a-4f8b-ac60-de745ca91a33 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:41.329157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a2a5737d-824a-4f8b-ac60-de745ca91a33 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:41.329548 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a2a5737d-824a-4f8b-ac60-de745ca91a33 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:41.454825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-a2a5737d-824a-4f8b-ac60-de745ca91a33 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lazy-loading 'services' on Instance uuid 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:58:41.727331 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a2a5737d-824a-4f8b-ac60-de745ca91a33 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/os-volume_attachments/e645f60a-93dd-446d-a7f9-68f694e0ebce" status: 202 len: 0 microversion: 2.1 time: 0.507623 Jul 15 15:58:41.727938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 360/727] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 15:58:41 2022] DELETE /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/os-volume_attachments/e645f60a-93dd-446d-a7f9-68f694e0ebce => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:58:42.027653 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2a84e7c8-4d99-45b3-8136-2efe0818e33b tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:42.028211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2a84e7c8-4d99-45b3-8136-2efe0818e33b tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:42.034613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a84e7c8-4d99-45b3-8136-2efe0818e33b tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:42.035061 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a84e7c8-4d99-45b3-8136-2efe0818e33b tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:42.035868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a84e7c8-4d99-45b3-8136-2efe0818e33b tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:42.036303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2a84e7c8-4d99-45b3-8136-2efe0818e33b tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:42.186566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2a84e7c8-4d99-45b3-8136-2efe0818e33b tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:42.194655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2a84e7c8-4d99-45b3-8136-2efe0818e33b tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.171505 Jul 15 15:58:42.195210 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 368/728] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:42 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:43.212489 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d28360a5-cd8f-466e-af41-7c04f577b9d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:43.213219 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d28360a5-cd8f-466e-af41-7c04f577b9d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:43.219375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d28360a5-cd8f-466e-af41-7c04f577b9d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:43.219832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d28360a5-cd8f-466e-af41-7c04f577b9d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:43.220603 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d28360a5-cd8f-466e-af41-7c04f577b9d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:43.221037 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d28360a5-cd8f-466e-af41-7c04f577b9d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:43.293230 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fe56f210-e2ea-4610-b44c-a1fd7d6db456 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:58:43.294825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fe56f210-e2ea-4610-b44c-a1fd7d6db456 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:43.301527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe56f210-e2ea-4610-b44c-a1fd7d6db456 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:43.301921 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe56f210-e2ea-4610-b44c-a1fd7d6db456 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:43.302701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe56f210-e2ea-4610-b44c-a1fd7d6db456 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:43.303146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fe56f210-e2ea-4610-b44c-a1fd7d6db456 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:43.326648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-fe56f210-e2ea-4610-b44c-a1fd7d6db456 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'flavor' on Instance uuid d049f0c3-2447-4627-b276-74454c4f13fe {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:58:43.365739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d28360a5-cd8f-466e-af41-7c04f577b9d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:43.374397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d28360a5-cd8f-466e-af41-7c04f577b9d4 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.166818 Jul 15 15:58:43.374969 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 361/729] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:43 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:43.778260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fe56f210-e2ea-4610-b44c-a1fd7d6db456 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/action" status: 200 len: 32 microversion: 2.1 time: 0.489689 Jul 15 15:58:43.778866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 369/730] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:58:43 2022] POST /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/action => generated 32 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 15 15:58:43.787968 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-15a86209-6109-4998-a45b-600ddf118917 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:43.788592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-15a86209-6109-4998-a45b-600ddf118917 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:43.795310 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-15a86209-6109-4998-a45b-600ddf118917 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:43.795787 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-15a86209-6109-4998-a45b-600ddf118917 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:43.796579 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-15a86209-6109-4998-a45b-600ddf118917 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:43.797019 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-15a86209-6109-4998-a45b-600ddf118917 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:43.927441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-15a86209-6109-4998-a45b-600ddf118917 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:43.935562 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-15a86209-6109-4998-a45b-600ddf118917 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.151375 Jul 15 15:58:43.936129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 362/731] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:43 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:58:44.393082 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9ffdd987-b1fb-47ce-8ada-4ba87ea12322 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:44.393802 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9ffdd987-b1fb-47ce-8ada-4ba87ea12322 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:44.400924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9ffdd987-b1fb-47ce-8ada-4ba87ea12322 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:44.401377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9ffdd987-b1fb-47ce-8ada-4ba87ea12322 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:44.402233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9ffdd987-b1fb-47ce-8ada-4ba87ea12322 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:44.402872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9ffdd987-b1fb-47ce-8ada-4ba87ea12322 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:44.552615 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9ffdd987-b1fb-47ce-8ada-4ba87ea12322 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:44.560663 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9ffdd987-b1fb-47ce-8ada-4ba87ea12322 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.172299 Jul 15 15:58:44.561975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 370/732] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:44 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:44.952932 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8331985b-190a-4555-a30e-55390d5d6776 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:44.953548 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8331985b-190a-4555-a30e-55390d5d6776 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:44.960120 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8331985b-190a-4555-a30e-55390d5d6776 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:44.960842 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8331985b-190a-4555-a30e-55390d5d6776 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:44.961616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8331985b-190a-4555-a30e-55390d5d6776 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:44.962057 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8331985b-190a-4555-a30e-55390d5d6776 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:45.094846 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8331985b-190a-4555-a30e-55390d5d6776 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:45.102830 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8331985b-190a-4555-a30e-55390d5d6776 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.153717 Jul 15 15:58:45.103441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 363/733] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:44 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:45.578882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4e998f91-8163-48b1-91ec-cb1ff31d792f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:45.579535 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4e998f91-8163-48b1-91ec-cb1ff31d792f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:45.586594 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e998f91-8163-48b1-91ec-cb1ff31d792f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:45.587021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e998f91-8163-48b1-91ec-cb1ff31d792f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:45.588411 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e998f91-8163-48b1-91ec-cb1ff31d792f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:45.588854 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e998f91-8163-48b1-91ec-cb1ff31d792f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:45.730790 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4e998f91-8163-48b1-91ec-cb1ff31d792f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:45.739345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4e998f91-8163-48b1-91ec-cb1ff31d792f tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.164354 Jul 15 15:58:45.739917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 371/734] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:45 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:46.119585 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-89b2c403-69cc-403a-8d89-f782d6af188c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:46.120186 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-89b2c403-69cc-403a-8d89-f782d6af188c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:46.126538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89b2c403-69cc-403a-8d89-f782d6af188c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:46.126977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89b2c403-69cc-403a-8d89-f782d6af188c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:46.127781 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89b2c403-69cc-403a-8d89-f782d6af188c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:46.128211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89b2c403-69cc-403a-8d89-f782d6af188c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:46.255012 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-89b2c403-69cc-403a-8d89-f782d6af188c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:46.263011 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-89b2c403-69cc-403a-8d89-f782d6af188c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.147763 Jul 15 15:58:46.263609 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 364/735] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:46 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:46.756797 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d9fd3158-f0d8-4ed0-aa49-35c158323bde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:46.757407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d9fd3158-f0d8-4ed0-aa49-35c158323bde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:46.763922 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d9fd3158-f0d8-4ed0-aa49-35c158323bde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:46.764374 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d9fd3158-f0d8-4ed0-aa49-35c158323bde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:46.765137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d9fd3158-f0d8-4ed0-aa49-35c158323bde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:46.765577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d9fd3158-f0d8-4ed0-aa49-35c158323bde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:46.905055 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d9fd3158-f0d8-4ed0-aa49-35c158323bde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:46.912992 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d9fd3158-f0d8-4ed0-aa49-35c158323bde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.160053 Jul 15 15:58:46.913559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 372/736] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:46 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:47.280176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1136eee4-8d7c-4da9-aa5a-2a86b290d7de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:47.280724 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1136eee4-8d7c-4da9-aa5a-2a86b290d7de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:47.287178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1136eee4-8d7c-4da9-aa5a-2a86b290d7de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:47.287657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1136eee4-8d7c-4da9-aa5a-2a86b290d7de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:47.288419 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1136eee4-8d7c-4da9-aa5a-2a86b290d7de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:47.288855 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1136eee4-8d7c-4da9-aa5a-2a86b290d7de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:47.425568 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1136eee4-8d7c-4da9-aa5a-2a86b290d7de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:47.434036 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1136eee4-8d7c-4da9-aa5a-2a86b290d7de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.157725 Jul 15 15:58:47.434617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 365/737] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:47 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:47.930672 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f38941ee-f3d3-4c3d-9b7f-550df8f5bdb6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:47.931940 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f38941ee-f3d3-4c3d-9b7f-550df8f5bdb6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:47.938339 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f38941ee-f3d3-4c3d-9b7f-550df8f5bdb6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:47.938793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f38941ee-f3d3-4c3d-9b7f-550df8f5bdb6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:47.939606 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f38941ee-f3d3-4c3d-9b7f-550df8f5bdb6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:47.940052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f38941ee-f3d3-4c3d-9b7f-550df8f5bdb6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:48.083935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f38941ee-f3d3-4c3d-9b7f-550df8f5bdb6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:48.092814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f38941ee-f3d3-4c3d-9b7f-550df8f5bdb6 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.166647 Jul 15 15:58:48.093381 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 373/738] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:47 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:48.452899 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8448da26-ba45-45fa-a2ed-83736fbb9583 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:48.453517 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8448da26-ba45-45fa-a2ed-83736fbb9583 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:48.460052 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8448da26-ba45-45fa-a2ed-83736fbb9583 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:48.460757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8448da26-ba45-45fa-a2ed-83736fbb9583 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:48.461526 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8448da26-ba45-45fa-a2ed-83736fbb9583 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:48.461981 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8448da26-ba45-45fa-a2ed-83736fbb9583 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:48.590709 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8448da26-ba45-45fa-a2ed-83736fbb9583 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:48.598585 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8448da26-ba45-45fa-a2ed-83736fbb9583 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.149518 Jul 15 15:58:48.599187 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 366/739] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:48 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:49.109779 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ea44bac6-6c9a-4c94-b573-f9f43902defc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:49.110511 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ea44bac6-6c9a-4c94-b573-f9f43902defc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:49.117067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea44bac6-6c9a-4c94-b573-f9f43902defc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:49.117521 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea44bac6-6c9a-4c94-b573-f9f43902defc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:49.118965 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea44bac6-6c9a-4c94-b573-f9f43902defc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:49.119467 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ea44bac6-6c9a-4c94-b573-f9f43902defc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:49.263025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ea44bac6-6c9a-4c94-b573-f9f43902defc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:49.270915 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ea44bac6-6c9a-4c94-b573-f9f43902defc tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.165056 Jul 15 15:58:49.271510 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 374/740] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:49 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:49.615576 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5f572666-ad4a-47ae-a179-5aa83df690de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:49.616188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5f572666-ad4a-47ae-a179-5aa83df690de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:49.622649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5f572666-ad4a-47ae-a179-5aa83df690de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:49.623093 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5f572666-ad4a-47ae-a179-5aa83df690de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:49.623876 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5f572666-ad4a-47ae-a179-5aa83df690de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:49.624306 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5f572666-ad4a-47ae-a179-5aa83df690de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:49.749807 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5f572666-ad4a-47ae-a179-5aa83df690de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:49.757976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5f572666-ad4a-47ae-a179-5aa83df690de tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.146112 Jul 15 15:58:49.758544 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 367/741] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:49 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:50.287392 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8cb5e22b-31e8-4c16-bc25-30504ded11db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:50.288013 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8cb5e22b-31e8-4c16-bc25-30504ded11db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:50.294843 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cb5e22b-31e8-4c16-bc25-30504ded11db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:50.295313 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cb5e22b-31e8-4c16-bc25-30504ded11db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:50.296102 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cb5e22b-31e8-4c16-bc25-30504ded11db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:50.296595 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8cb5e22b-31e8-4c16-bc25-30504ded11db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:50.450322 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8cb5e22b-31e8-4c16-bc25-30504ded11db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:50.458267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8cb5e22b-31e8-4c16-bc25-30504ded11db tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.174953 Jul 15 15:58:50.458845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 375/742] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:50 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:50.618973 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ffe4213a-fdfc-4f5e-a0fe-a6940f4a6838 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: .version_select at 0x7f510f20b430>, body: {"keypair": {"name": "tempest-keypair-1287969267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiHqmZCjDet33W3IYROy/w4ygoDzeLYpyuqjJveMbcuSmK4vHAPzCWAocOijTHupot0qqKkIPhvdAjws34w6/oduoWrf+K4PrxRdp7WqOXuXYkvr5XlX2INsXJLtRwWlg=="}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:58:50.633385 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-ffe4213a-fdfc-4f5e-a0fe-a6940f4a6838 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for project c35d3e93d36040bba1bbb873e61d239a. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:58:50.637162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-ffe4213a-fdfc-4f5e-a0fe-a6940f4a6838 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for user 1157b91a306540dd98a072b1ea4941b2 and project c35d3e93d36040bba1bbb873e61d239a. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:58:50.712230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ffe4213a-fdfc-4f5e-a0fe-a6940f4a6838 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097455 Jul 15 15:58:50.712896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 368/743] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 15:58:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:58:50.774080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4caad642-a07f-47aa-8de6-268922a1a565 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:50.774702 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4caad642-a07f-47aa-8de6-268922a1a565 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:50.781061 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4caad642-a07f-47aa-8de6-268922a1a565 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:50.795939 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4caad642-a07f-47aa-8de6-268922a1a565 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:50.795939 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4caad642-a07f-47aa-8de6-268922a1a565 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:50.795939 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4caad642-a07f-47aa-8de6-268922a1a565 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:50.800954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:58:50.917600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4caad642-a07f-47aa-8de6-268922a1a565 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:50.925593 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4caad642-a07f-47aa-8de6-268922a1a565 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.155365 Jul 15 15:58:50.931544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 376/744] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:50 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:51.475619 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-69741d33-cadf-4b31-b2a8-d1ed0113a4f0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:51.476153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-69741d33-cadf-4b31-b2a8-d1ed0113a4f0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:51.482180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-69741d33-cadf-4b31-b2a8-d1ed0113a4f0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:51.482632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-69741d33-cadf-4b31-b2a8-d1ed0113a4f0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:51.483427 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-69741d33-cadf-4b31-b2a8-d1ed0113a4f0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:51.483906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-69741d33-cadf-4b31-b2a8-d1ed0113a4f0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:51.653651 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-69741d33-cadf-4b31-b2a8-d1ed0113a4f0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:51.670350 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-69741d33-cadf-4b31-b2a8-d1ed0113a4f0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.190890 Jul 15 15:58:51.670350 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 369/745] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:51 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:51.943011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ae1d5e45-962c-42ee-9a6a-3f462987ced8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:51.943659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ae1d5e45-962c-42ee-9a6a-3f462987ced8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:51.950993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ae1d5e45-962c-42ee-9a6a-3f462987ced8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:51.951483 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ae1d5e45-962c-42ee-9a6a-3f462987ced8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:51.952267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ae1d5e45-962c-42ee-9a6a-3f462987ced8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:51.952730 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ae1d5e45-962c-42ee-9a6a-3f462987ced8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:52.093718 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ae1d5e45-962c-42ee-9a6a-3f462987ced8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:52.104400 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ae1d5e45-962c-42ee-9a6a-3f462987ced8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.165209 Jul 15 15:58:52.105127 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 377/746] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:51 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:52.325832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1f023a47-3d36-4681-9b82-d79886fc6518 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:58:52.331847 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1f023a47-3d36-4681-9b82-d79886fc6518 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:52.332284 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1f023a47-3d36-4681-9b82-d79886fc6518 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:52.355653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1f023a47-3d36-4681-9b82-d79886fc6518 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Going to try to stop instance {{(pid=130090) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 15:58:52.582293 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1f023a47-3d36-4681-9b82-d79886fc6518 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/action" status: 202 len: 0 microversion: 2.1 time: 0.260552 Jul 15 15:58:52.582920 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 370/747] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:58:52 2022] POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:58:52.591521 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-16a47c48-0c46-4291-a762-3891a2af3323 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:52.592227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-16a47c48-0c46-4291-a762-3891a2af3323 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:52.598716 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16a47c48-0c46-4291-a762-3891a2af3323 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:52.599237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16a47c48-0c46-4291-a762-3891a2af3323 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:52.600077 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16a47c48-0c46-4291-a762-3891a2af3323 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:52.600514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16a47c48-0c46-4291-a762-3891a2af3323 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:52.680784 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-efa75961-766a-4555-9433-918bba91e091 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:52.681410 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-efa75961-766a-4555-9433-918bba91e091 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:52.688301 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efa75961-766a-4555-9433-918bba91e091 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:52.688867 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efa75961-766a-4555-9433-918bba91e091 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:52.689750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efa75961-766a-4555-9433-918bba91e091 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:52.690322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-efa75961-766a-4555-9433-918bba91e091 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:52.738670 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-16a47c48-0c46-4291-a762-3891a2af3323 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:52.746824 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-16a47c48-0c46-4291-a762-3891a2af3323 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.159356 Jul 15 15:58:52.747697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 378/748] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:52 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:52.924079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-efa75961-766a-4555-9433-918bba91e091 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:52.932764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-efa75961-766a-4555-9433-918bba91e091 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.256685 Jul 15 15:58:52.933278 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 371/749] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:52 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:58:53.125572 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5a740fd8-299e-4609-9699-ec8803d18d09 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:53.126174 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5a740fd8-299e-4609-9699-ec8803d18d09 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:53.132708 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5a740fd8-299e-4609-9699-ec8803d18d09 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:53.133148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5a740fd8-299e-4609-9699-ec8803d18d09 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:53.133937 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5a740fd8-299e-4609-9699-ec8803d18d09 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:53.134367 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5a740fd8-299e-4609-9699-ec8803d18d09 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:53.257833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2124997293", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0ec6ba6-6b6c-449a-8ed1-834796a501b5"}], "security_groups": [{"name": "tempest-securitygroup--1351644136"}], "key_name": "tempest-keypair-1287969267", "user_data": "}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:58:53.266088 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5a740fd8-299e-4609-9699-ec8803d18d09 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:53.274118 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5a740fd8-299e-4609-9699-ec8803d18d09 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.152569 Jul 15 15:58:53.275804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 379/750] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:53 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:53.357572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] validate_networks() for [('a0ec6ba6-6b6c-449a-8ed1-834796a501b5', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:58:53.764857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ad22d371-ffed-4509-a72d-26c9f752e6a2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:53.765379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ad22d371-ffed-4509-a72d-26c9f752e6a2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:53.769364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:58:53.769840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:58:53.770246 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:58:53.770652 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:58:53.771064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:58:53.771396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ad22d371-ffed-4509-a72d-26c9f752e6a2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:53.771850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ad22d371-ffed-4509-a72d-26c9f752e6a2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:53.772614 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ad22d371-ffed-4509-a72d-26c9f752e6a2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:53.773084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ad22d371-ffed-4509-a72d-26c9f752e6a2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:53.780730 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:53.781176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:53.781989 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:53.782422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:53.800345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for project c35d3e93d36040bba1bbb873e61d239a. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:58:53.804458 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for user 1157b91a306540dd98a072b1ea4941b2 and project c35d3e93d36040bba1bbb873e61d239a. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:58:53.815635 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:58:53.817917 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:58:53.906655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ad22d371-ffed-4509-a72d-26c9f752e6a2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:53.914119 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ad22d371-ffed-4509-a72d-26c9f752e6a2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.153147 Jul 15 15:58:53.914684 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 380/751] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:53 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:58:53.949063 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d0023f24-bacd-4e95-8d29-f4e29b3db8f2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.695340 Jul 15 15:58:53.950029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 372/752] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 15:58:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 15:58:53.950153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fa2ce17e-9c93-4358-a035-f7484d495e49 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:53.950834 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fa2ce17e-9c93-4358-a035-f7484d495e49 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:53.957263 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa2ce17e-9c93-4358-a035-f7484d495e49 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:53.957731 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa2ce17e-9c93-4358-a035-f7484d495e49 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:53.958474 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa2ce17e-9c93-4358-a035-f7484d495e49 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:53.958904 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa2ce17e-9c93-4358-a035-f7484d495e49 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:53.960101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1ddccfca-a902-4222-b3d2-1eded4248780 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:53.961022 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1ddccfca-a902-4222-b3d2-1eded4248780 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:54.026711 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1ddccfca-a902-4222-b3d2-1eded4248780 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:54.036117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1ddccfca-a902-4222-b3d2-1eded4248780 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1242 microversion: 2.1 time: 0.080238 Jul 15 15:58:54.036732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 373/753] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:53 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:54.105515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fa2ce17e-9c93-4358-a035-f7484d495e49 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:54.113827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fa2ce17e-9c93-4358-a035-f7484d495e49 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.168112 Jul 15 15:58:54.114394 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 381/754] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:53 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:58:54.292807 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b2fa2dbe-7bdc-47d7-a42f-7a5242ef5245 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:54.293347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b2fa2dbe-7bdc-47d7-a42f-7a5242ef5245 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:54.300004 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b2fa2dbe-7bdc-47d7-a42f-7a5242ef5245 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:54.300456 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b2fa2dbe-7bdc-47d7-a42f-7a5242ef5245 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:54.301223 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b2fa2dbe-7bdc-47d7-a42f-7a5242ef5245 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:54.301658 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b2fa2dbe-7bdc-47d7-a42f-7a5242ef5245 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:54.305744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:58:54.431052 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b2fa2dbe-7bdc-47d7-a42f-7a5242ef5245 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:54.439035 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b2fa2dbe-7bdc-47d7-a42f-7a5242ef5245 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.150697 Jul 15 15:58:54.439635 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 374/755] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:54 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:54.931767 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-19e5d2f4-325c-4059-87fd-2dd6558058bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:54.932424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-19e5d2f4-325c-4059-87fd-2dd6558058bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:54.938989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-19e5d2f4-325c-4059-87fd-2dd6558058bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:54.939482 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-19e5d2f4-325c-4059-87fd-2dd6558058bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:54.940305 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-19e5d2f4-325c-4059-87fd-2dd6558058bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:54.940791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-19e5d2f4-325c-4059-87fd-2dd6558058bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:55.055408 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e98d4aa9-6945-4ca6-a696-8d4c57c5dd9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:55.056602 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e98d4aa9-6945-4ca6-a696-8d4c57c5dd9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:55.063545 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e98d4aa9-6945-4ca6-a696-8d4c57c5dd9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:55.064001 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e98d4aa9-6945-4ca6-a696-8d4c57c5dd9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:55.064930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e98d4aa9-6945-4ca6-a696-8d4c57c5dd9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:55.065375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e98d4aa9-6945-4ca6-a696-8d4c57c5dd9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:55.076534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-19e5d2f4-325c-4059-87fd-2dd6558058bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:55.084467 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-19e5d2f4-325c-4059-87fd-2dd6558058bf tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.157063 Jul 15 15:58:55.085007 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 382/756] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:54 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:55.128645 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e98d4aa9-6945-4ca6-a696-8d4c57c5dd9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:55.131870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9cd3b3f2-f516-4d67-8c65-2ab413b58fde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:55.132861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9cd3b3f2-f516-4d67-8c65-2ab413b58fde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:55.136515 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e98d4aa9-6945-4ca6-a696-8d4c57c5dd9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1246 microversion: 2.1 time: 0.085541 Jul 15 15:58:55.137103 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 375/757] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:55 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:55.139425 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cd3b3f2-f516-4d67-8c65-2ab413b58fde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:55.139760 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cd3b3f2-f516-4d67-8c65-2ab413b58fde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:55.140605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cd3b3f2-f516-4d67-8c65-2ab413b58fde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:55.141146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9cd3b3f2-f516-4d67-8c65-2ab413b58fde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:55.293065 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9cd3b3f2-f516-4d67-8c65-2ab413b58fde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:55.300957 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9cd3b3f2-f516-4d67-8c65-2ab413b58fde tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.174708 Jul 15 15:58:55.301522 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 383/758] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:55 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:58:55.456698 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d7ea7e4d-f8c3-4abe-a11e-57344fa6c165 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:55.457329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d7ea7e4d-f8c3-4abe-a11e-57344fa6c165 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:55.464279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d7ea7e4d-f8c3-4abe-a11e-57344fa6c165 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:55.464729 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d7ea7e4d-f8c3-4abe-a11e-57344fa6c165 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:55.465497 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d7ea7e4d-f8c3-4abe-a11e-57344fa6c165 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:55.465938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d7ea7e4d-f8c3-4abe-a11e-57344fa6c165 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:55.596514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d7ea7e4d-f8c3-4abe-a11e-57344fa6c165 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:55.604615 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d7ea7e4d-f8c3-4abe-a11e-57344fa6c165 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.151721 Jul 15 15:58:55.605181 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 376/759] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:55 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:56.102173 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1ff5d08c-1b95-4d2e-9dd9-038137c458e7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:56.103285 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1ff5d08c-1b95-4d2e-9dd9-038137c458e7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:56.109869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ff5d08c-1b95-4d2e-9dd9-038137c458e7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:56.110325 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ff5d08c-1b95-4d2e-9dd9-038137c458e7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:56.111098 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ff5d08c-1b95-4d2e-9dd9-038137c458e7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:56.111575 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ff5d08c-1b95-4d2e-9dd9-038137c458e7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:56.152946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4732ab61-fc49-46c6-8644-dc4f24dad01b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:56.153867 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4732ab61-fc49-46c6-8644-dc4f24dad01b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:56.160890 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4732ab61-fc49-46c6-8644-dc4f24dad01b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:56.161338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4732ab61-fc49-46c6-8644-dc4f24dad01b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:56.162112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4732ab61-fc49-46c6-8644-dc4f24dad01b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:56.162549 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4732ab61-fc49-46c6-8644-dc4f24dad01b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:56.225823 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4732ab61-fc49-46c6-8644-dc4f24dad01b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:56.234058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4732ab61-fc49-46c6-8644-dc4f24dad01b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1238 microversion: 2.1 time: 0.084919 Jul 15 15:58:56.234645 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 377/760] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:56 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:58:56.251190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1ff5d08c-1b95-4d2e-9dd9-038137c458e7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:56.258816 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1ff5d08c-1b95-4d2e-9dd9-038137c458e7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.160535 Jul 15 15:58:56.259438 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 384/761] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:56 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:56.318640 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-885b2635-1c93-4739-b878-2388be1cfe22 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:56.319247 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-885b2635-1c93-4739-b878-2388be1cfe22 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:56.325357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-885b2635-1c93-4739-b878-2388be1cfe22 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:56.325801 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-885b2635-1c93-4739-b878-2388be1cfe22 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:56.326551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-885b2635-1c93-4739-b878-2388be1cfe22 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:56.326978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-885b2635-1c93-4739-b878-2388be1cfe22 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:56.466994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-885b2635-1c93-4739-b878-2388be1cfe22 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:56.475498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-885b2635-1c93-4739-b878-2388be1cfe22 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.160670 Jul 15 15:58:56.476077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 378/762] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:56 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:56.621714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-cdf5d734-9fb1-4471-b992-516376311f42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:56.622347 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-cdf5d734-9fb1-4471-b992-516376311f42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:56.628351 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cdf5d734-9fb1-4471-b992-516376311f42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:56.628803 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cdf5d734-9fb1-4471-b992-516376311f42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:56.629572 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cdf5d734-9fb1-4471-b992-516376311f42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:56.630011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cdf5d734-9fb1-4471-b992-516376311f42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:56.762040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-cdf5d734-9fb1-4471-b992-516376311f42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:56.769999 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-cdf5d734-9fb1-4471-b992-516376311f42 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.152272 Jul 15 15:58:56.770616 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 385/763] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:56 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:57.254480 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-991e525c-ede1-4856-b93e-5eeb60d8624e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:57.255097 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-991e525c-ede1-4856-b93e-5eeb60d8624e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:57.261869 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-991e525c-ede1-4856-b93e-5eeb60d8624e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:57.262329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-991e525c-ede1-4856-b93e-5eeb60d8624e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:57.263097 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-991e525c-ede1-4856-b93e-5eeb60d8624e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:57.263563 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-991e525c-ede1-4856-b93e-5eeb60d8624e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:57.276349 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6513bdbd-d7d5-4168-bc74-61bf1f3de4ce tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:57.276962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6513bdbd-d7d5-4168-bc74-61bf1f3de4ce tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:57.283414 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6513bdbd-d7d5-4168-bc74-61bf1f3de4ce tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:57.283869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6513bdbd-d7d5-4168-bc74-61bf1f3de4ce tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:57.284637 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6513bdbd-d7d5-4168-bc74-61bf1f3de4ce tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:57.285079 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6513bdbd-d7d5-4168-bc74-61bf1f3de4ce tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:57.325591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-991e525c-ede1-4856-b93e-5eeb60d8624e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:57.333106 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-991e525c-ede1-4856-b93e-5eeb60d8624e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1294 microversion: 2.1 time: 0.082453 Jul 15 15:58:57.333679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 379/764] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:57 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:57.415175 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6513bdbd-d7d5-4168-bc74-61bf1f3de4ce tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:57.422864 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6513bdbd-d7d5-4168-bc74-61bf1f3de4ce tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.150920 Jul 15 15:58:57.423459 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 386/765] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:57 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:58:57.493282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f28bb076-9b12-45d5-bded-75dc1e3978e8 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:57.493894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f28bb076-9b12-45d5-bded-75dc1e3978e8 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:57.499873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f28bb076-9b12-45d5-bded-75dc1e3978e8 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:57.500323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f28bb076-9b12-45d5-bded-75dc1e3978e8 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:57.501086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f28bb076-9b12-45d5-bded-75dc1e3978e8 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:57.501527 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f28bb076-9b12-45d5-bded-75dc1e3978e8 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:57.641557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f28bb076-9b12-45d5-bded-75dc1e3978e8 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:57.649927 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f28bb076-9b12-45d5-bded-75dc1e3978e8 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1756 microversion: 2.1 time: 0.159933 Jul 15 15:58:57.650493 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 380/766] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:57 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:57.787732 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d0348900-6711-4939-9d06-16e053f706d7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:57.788339 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d0348900-6711-4939-9d06-16e053f706d7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:57.794343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d0348900-6711-4939-9d06-16e053f706d7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:57.794793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d0348900-6711-4939-9d06-16e053f706d7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:57.795586 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d0348900-6711-4939-9d06-16e053f706d7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:57.796020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d0348900-6711-4939-9d06-16e053f706d7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:57.927841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d0348900-6711-4939-9d06-16e053f706d7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:57.936387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d0348900-6711-4939-9d06-16e053f706d7 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.152614 Jul 15 15:58:57.936959 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 387/767] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:57 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:58.350895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d7303a6c-3cb3-4c29-9dd1-ee7910a8a7bb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:58.351575 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d7303a6c-3cb3-4c29-9dd1-ee7910a8a7bb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:58.358534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d7303a6c-3cb3-4c29-9dd1-ee7910a8a7bb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:58.358986 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d7303a6c-3cb3-4c29-9dd1-ee7910a8a7bb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:58.359793 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d7303a6c-3cb3-4c29-9dd1-ee7910a8a7bb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:58.360234 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d7303a6c-3cb3-4c29-9dd1-ee7910a8a7bb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:58.422602 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d7303a6c-3cb3-4c29-9dd1-ee7910a8a7bb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:58.430015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d7303a6c-3cb3-4c29-9dd1-ee7910a8a7bb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1294 microversion: 2.1 time: 0.082921 Jul 15 15:58:58.431477 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 381/768] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:58 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:58.440506 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d0dc6162-0eee-4868-93a6-02fbc9f6ab35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:58.441125 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d0dc6162-0eee-4868-93a6-02fbc9f6ab35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:58.447724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d0dc6162-0eee-4868-93a6-02fbc9f6ab35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:58.448181 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d0dc6162-0eee-4868-93a6-02fbc9f6ab35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:58.448952 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d0dc6162-0eee-4868-93a6-02fbc9f6ab35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:58.449394 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d0dc6162-0eee-4868-93a6-02fbc9f6ab35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:58.579302 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d0dc6162-0eee-4868-93a6-02fbc9f6ab35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:58.590485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d0dc6162-0eee-4868-93a6-02fbc9f6ab35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.151444 Jul 15 15:58:58.591326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 388/769] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:58 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:58.666752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d2d2aa80-e505-4428-844d-d5de07d1c652 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:58.667432 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d2d2aa80-e505-4428-844d-d5de07d1c652 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:58.673642 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d2d2aa80-e505-4428-844d-d5de07d1c652 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:58.674096 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d2d2aa80-e505-4428-844d-d5de07d1c652 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:58.674872 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d2d2aa80-e505-4428-844d-d5de07d1c652 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:58.675366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d2d2aa80-e505-4428-844d-d5de07d1c652 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:58.817679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d2d2aa80-e505-4428-844d-d5de07d1c652 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:58.826313 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d2d2aa80-e505-4428-844d-d5de07d1c652 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1759 microversion: 2.1 time: 0.164191 Jul 15 15:58:58.827023 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 382/770] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:58 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:58.953631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2875a8be-9ffd-44c5-8685-2fcc7cde3a72 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:58.954279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2875a8be-9ffd-44c5-8685-2fcc7cde3a72 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:58.960774 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2875a8be-9ffd-44c5-8685-2fcc7cde3a72 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:58.961223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2875a8be-9ffd-44c5-8685-2fcc7cde3a72 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:58.962021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2875a8be-9ffd-44c5-8685-2fcc7cde3a72 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:58.962463 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2875a8be-9ffd-44c5-8685-2fcc7cde3a72 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:59.090804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2875a8be-9ffd-44c5-8685-2fcc7cde3a72 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:59.098863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2875a8be-9ffd-44c5-8685-2fcc7cde3a72 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1735 microversion: 2.1 time: 0.149050 Jul 15 15:58:59.104486 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 389/771] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:58 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:59.447387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-05a93b9b-9498-45a7-838c-ef225d01ab1d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:59.448030 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-05a93b9b-9498-45a7-838c-ef225d01ab1d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:59.454589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-05a93b9b-9498-45a7-838c-ef225d01ab1d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:59.455037 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-05a93b9b-9498-45a7-838c-ef225d01ab1d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:59.455830 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-05a93b9b-9498-45a7-838c-ef225d01ab1d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:59.456260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-05a93b9b-9498-45a7-838c-ef225d01ab1d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:59.517433 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-05a93b9b-9498-45a7-838c-ef225d01ab1d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:59.525241 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-05a93b9b-9498-45a7-838c-ef225d01ab1d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1302 microversion: 2.1 time: 0.081733 Jul 15 15:58:59.525799 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 383/772] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:59 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:58:59.614514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4940515b-61b3-403f-84a4-188d880de016 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:58:59.615130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4940515b-61b3-403f-84a4-188d880de016 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:58:59.626024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4940515b-61b3-403f-84a4-188d880de016 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:59.626024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4940515b-61b3-403f-84a4-188d880de016 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:59.626024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4940515b-61b3-403f-84a4-188d880de016 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:58:59.626024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4940515b-61b3-403f-84a4-188d880de016 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:58:59.771222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4940515b-61b3-403f-84a4-188d880de016 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:58:59.779956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4940515b-61b3-403f-84a4-188d880de016 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.173934 Jul 15 15:58:59.789964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 390/773] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:58:59 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:00.119825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3e4223fa-3c2a-4b9e-ad8b-53376416419f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:00.120552 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3e4223fa-3c2a-4b9e-ad8b-53376416419f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:00.126595 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e4223fa-3c2a-4b9e-ad8b-53376416419f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.127041 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e4223fa-3c2a-4b9e-ad8b-53376416419f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.127838 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e4223fa-3c2a-4b9e-ad8b-53376416419f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.128264 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3e4223fa-3c2a-4b9e-ad8b-53376416419f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.293396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3e4223fa-3c2a-4b9e-ad8b-53376416419f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:00.301544 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3e4223fa-3c2a-4b9e-ad8b-53376416419f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1715 microversion: 2.1 time: 0.188104 Jul 15 15:59:00.303512 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 384/774] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:00 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1715 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:00.359385 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:00.364689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:00.366211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.366667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.367471 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.367949 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.502021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] HTTP exception thrown: Cannot 'detach_volume' instance d049f0c3-2447-4627-b276-74454c4f13fe while it is in vm_state rescued Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Request method failure captured: Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments/3b57fddf-62d5-4a6f-aea4-05cb6694e915 HTTP/1.1 Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y10DzbCS3DQTJU_gOOd285DZTxYv1yhcYcCSsQgBFQAGtklPsOguTMShhZJ5Ew7xUEU6GJKnp-xBWPYGp3VznxicKE-i7ZE6HMPq8QSBFfrHO1UjcinhOzqEORciPh99KYHoGPoluej5qLBpDvS1Y3G68GwOhTLuHfT-xYlD-__kA4 Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:59:00.503704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 9005cb23317a4a05b58e99284824135e Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 15:59:00.505032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Cannot 'detach_volume' instance d049f0c3-2447-4627-b276-74454c4f13fe while it is in vm_state rescued Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'server_id': 'd049f0c3-2447-4627-b276-74454c4f13fe', 'id': '3b57fddf-62d5-4a6f-aea4-05cb6694e915'} Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d049f0c3-2447-4627-b276-74454c4f13fe in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:59:00.505713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d049f0c3-2447-4627-b276-74454c4f13fe while it is in vm_state rescued Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d049f0c3-2447-4627-b276-74454c4f13fe while it is in vm_state rescued Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:00.506988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Returning 409 to user: Cannot 'detach_volume' instance d049f0c3-2447-4627-b276-74454c4f13fe while it is in vm_state rescued {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:59:00.509049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-075161e0-6ce9-4ace-8fb9-e9b8d9ed137e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments/3b57fddf-62d5-4a6f-aea4-05cb6694e915" status: 409 len: 152 microversion: 2.1 time: 0.150008 Jul 15 15:59:00.509049 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 391/775] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 15:59:00 2022] DELETE /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments/3b57fddf-62d5-4a6f-aea4-05cb6694e915 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 15:59:00.515750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-27c09a90-a1f1-4e62-84f5-f48ef351ddad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:00.516287 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-27c09a90-a1f1-4e62-84f5-f48ef351ddad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:00.522722 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27c09a90-a1f1-4e62-84f5-f48ef351ddad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.527159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27c09a90-a1f1-4e62-84f5-f48ef351ddad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.527159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27c09a90-a1f1-4e62-84f5-f48ef351ddad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.527159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27c09a90-a1f1-4e62-84f5-f48ef351ddad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.544958 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-59c80cb1-3e4c-4c88-afef-a11cbd73d30f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:00.545671 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-59c80cb1-3e4c-4c88-afef-a11cbd73d30f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:00.554383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-59c80cb1-3e4c-4c88-afef-a11cbd73d30f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.554845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-59c80cb1-3e4c-4c88-afef-a11cbd73d30f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.555677 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-59c80cb1-3e4c-4c88-afef-a11cbd73d30f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.556121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-59c80cb1-3e4c-4c88-afef-a11cbd73d30f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.622742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-59c80cb1-3e4c-4c88-afef-a11cbd73d30f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:00.630310 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-59c80cb1-3e4c-4c88-afef-a11cbd73d30f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1300 microversion: 2.1 time: 0.089322 Jul 15 15:59:00.630869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 392/776] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:00 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:00.801674 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d998b36a-0a9b-4dd7-9177-74d4342d1547 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:00.801892 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d998b36a-0a9b-4dd7-9177-74d4342d1547 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:00.808907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d998b36a-0a9b-4dd7-9177-74d4342d1547 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.809493 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d998b36a-0a9b-4dd7-9177-74d4342d1547 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.810366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d998b36a-0a9b-4dd7-9177-74d4342d1547 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.810809 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d998b36a-0a9b-4dd7-9177-74d4342d1547 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.816416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:00.817222 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-27c09a90-a1f1-4e62-84f5-f48ef351ddad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "POST /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/action" status: 202 len: 0 microversion: 2.1 time: 0.305005 Jul 15 15:59:00.818692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 385/777] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:59:00 2022] POST /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:59:00.827713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-baf6fb5b-6333-43dc-867a-3b6b16650772 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:00.830188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-baf6fb5b-6333-43dc-867a-3b6b16650772 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:00.837309 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-baf6fb5b-6333-43dc-867a-3b6b16650772 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.838087 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-baf6fb5b-6333-43dc-867a-3b6b16650772 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.839175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-baf6fb5b-6333-43dc-867a-3b6b16650772 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:00.839647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-baf6fb5b-6333-43dc-867a-3b6b16650772 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:00.971980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d998b36a-0a9b-4dd7-9177-74d4342d1547 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:00.981307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d998b36a-0a9b-4dd7-9177-74d4342d1547 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.183953 Jul 15 15:59:00.982291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 393/778] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:00 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:01.067515 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-baf6fb5b-6333-43dc-867a-3b6b16650772 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:01.076475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-baf6fb5b-6333-43dc-867a-3b6b16650772 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1723 microversion: 2.1 time: 0.253059 Jul 15 15:59:01.077193 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 386/779] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:00 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:01.647199 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a09fad04-6970-4bc1-965e-ec571249f83a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:01.647920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a09fad04-6970-4bc1-965e-ec571249f83a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:01.655844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a09fad04-6970-4bc1-965e-ec571249f83a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:01.663816 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a09fad04-6970-4bc1-965e-ec571249f83a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:01.663816 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a09fad04-6970-4bc1-965e-ec571249f83a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:01.663816 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a09fad04-6970-4bc1-965e-ec571249f83a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:01.705668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-8ccecfe2-e9ac-475d-8946-fc3105622d20 req-e2c6220f-2147-45ad-8e47-cac5d6aa3ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415beda2-d5fa-4cbe-99ae-9802fa6a0dfa", "tag": "9a4249d9-e236-41ac-8714-1ff0e3f04d17"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:01.723537 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-8ccecfe2-e9ac-475d-8946-fc3105622d20 req-e2c6220f-2147-45ad-8e47-cac5d6aa3ba5 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:01.724170 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-8ccecfe2-e9ac-475d-8946-fc3105622d20 req-e2c6220f-2147-45ad-8e47-cac5d6aa3ba5 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:01.750668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-8ccecfe2-e9ac-475d-8946-fc3105622d20 req-e2c6220f-2147-45ad-8e47-cac5d6aa3ba5 service nova] Creating event network-changed:9a4249d9-e236-41ac-8714-1ff0e3f04d17 for instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa on hv-cinder-83587 Jul 15 15:59:01.756728 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-8ccecfe2-e9ac-475d-8946-fc3105622d20 req-e2c6220f-2147-45ad-8e47-cac5d6aa3ba5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054889 Jul 15 15:59:01.757392 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 387/780] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:01.829599 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a09fad04-6970-4bc1-965e-ec571249f83a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:01.838560 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a09fad04-6970-4bc1-965e-ec571249f83a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.195141 Jul 15 15:59:01.839273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 394/781] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:01 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:01.998396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c39e1e80-2024-4d1c-a3bd-bdb2620a0c3b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:01.999124 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c39e1e80-2024-4d1c-a3bd-bdb2620a0c3b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:02.005495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c39e1e80-2024-4d1c-a3bd-bdb2620a0c3b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:02.005951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c39e1e80-2024-4d1c-a3bd-bdb2620a0c3b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:02.006722 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c39e1e80-2024-4d1c-a3bd-bdb2620a0c3b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:02.007162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c39e1e80-2024-4d1c-a3bd-bdb2620a0c3b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:02.094300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-de77a5a4-6dd1-4f83-a387-4b6f838c66a6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:02.095038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-de77a5a4-6dd1-4f83-a387-4b6f838c66a6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:02.101576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de77a5a4-6dd1-4f83-a387-4b6f838c66a6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:02.102037 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de77a5a4-6dd1-4f83-a387-4b6f838c66a6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:02.102821 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de77a5a4-6dd1-4f83-a387-4b6f838c66a6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:02.103260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de77a5a4-6dd1-4f83-a387-4b6f838c66a6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:02.141123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c39e1e80-2024-4d1c-a3bd-bdb2620a0c3b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:02.148924 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c39e1e80-2024-4d1c-a3bd-bdb2620a0c3b tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.154682 Jul 15 15:59:02.155523 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 388/782] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:01 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:02.233934 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-de77a5a4-6dd1-4f83-a387-4b6f838c66a6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:02.241901 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-de77a5a4-6dd1-4f83-a387-4b6f838c66a6 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1723 microversion: 2.1 time: 0.151644 Jul 15 15:59:02.242467 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 395/783] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:02 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:02.856081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-df6cfacc-7c56-475f-a3c7-a81112917093 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:02.856699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-df6cfacc-7c56-475f-a3c7-a81112917093 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:02.863319 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df6cfacc-7c56-475f-a3c7-a81112917093 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:02.863775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df6cfacc-7c56-475f-a3c7-a81112917093 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:02.864546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df6cfacc-7c56-475f-a3c7-a81112917093 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:02.864984 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df6cfacc-7c56-475f-a3c7-a81112917093 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:02.993590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-df6cfacc-7c56-475f-a3c7-a81112917093 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:03.000977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-df6cfacc-7c56-475f-a3c7-a81112917093 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.149307 Jul 15 15:59:03.001552 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 389/784] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:02 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:03.166539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c93904cd-13c8-4853-9364-ba08e9486463 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:03.167052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c93904cd-13c8-4853-9364-ba08e9486463 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:03.173631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c93904cd-13c8-4853-9364-ba08e9486463 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:03.174081 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c93904cd-13c8-4853-9364-ba08e9486463 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:03.174884 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c93904cd-13c8-4853-9364-ba08e9486463 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:03.175340 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c93904cd-13c8-4853-9364-ba08e9486463 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:03.259883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-77cc3203-7b2d-44a4-ba70-2e028d7e8eda tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:03.260531 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-77cc3203-7b2d-44a4-ba70-2e028d7e8eda tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:03.266704 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-77cc3203-7b2d-44a4-ba70-2e028d7e8eda tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:03.267161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-77cc3203-7b2d-44a4-ba70-2e028d7e8eda tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:03.268118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-77cc3203-7b2d-44a4-ba70-2e028d7e8eda tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:03.268605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-77cc3203-7b2d-44a4-ba70-2e028d7e8eda tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:03.287764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:03.313358 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c93904cd-13c8-4853-9364-ba08e9486463 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:03.321052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c93904cd-13c8-4853-9364-ba08e9486463 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.158871 Jul 15 15:59:03.321630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 396/785] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:03 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:03.406824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-77cc3203-7b2d-44a4-ba70-2e028d7e8eda tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:03.414775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-77cc3203-7b2d-44a4-ba70-2e028d7e8eda tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1723 microversion: 2.1 time: 0.158936 Jul 15 15:59:03.415348 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 390/786] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:03 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:04.017941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4cd437a4-9ee6-482b-8171-eec85b5ba02b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:04.018554 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4cd437a4-9ee6-482b-8171-eec85b5ba02b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:04.020486 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=67 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:04.025789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4cd437a4-9ee6-482b-8171-eec85b5ba02b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:04.026246 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4cd437a4-9ee6-482b-8171-eec85b5ba02b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:04.027010 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4cd437a4-9ee6-482b-8171-eec85b5ba02b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:04.027477 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4cd437a4-9ee6-482b-8171-eec85b5ba02b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:04.161711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4cd437a4-9ee6-482b-8171-eec85b5ba02b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:04.169317 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4cd437a4-9ee6-482b-8171-eec85b5ba02b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.155270 Jul 15 15:59:04.170165 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 397/787] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:04 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:04.338744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-94e1f93f-4f09-490c-9ac7-cfbc9594ceb9 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:04.339422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-94e1f93f-4f09-490c-9ac7-cfbc9594ceb9 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:04.341595 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:04.342697 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=12 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:04.343345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:04.348294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94e1f93f-4f09-490c-9ac7-cfbc9594ceb9 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:04.348744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94e1f93f-4f09-490c-9ac7-cfbc9594ceb9 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:04.349512 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94e1f93f-4f09-490c-9ac7-cfbc9594ceb9 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:04.349946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94e1f93f-4f09-490c-9ac7-cfbc9594ceb9 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:04.432216 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7e732862-f6ba-4f2c-9f0a-c11d48354cf3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:04.432832 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7e732862-f6ba-4f2c-9f0a-c11d48354cf3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:04.439088 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7e732862-f6ba-4f2c-9f0a-c11d48354cf3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:04.441942 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7e732862-f6ba-4f2c-9f0a-c11d48354cf3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:04.441942 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7e732862-f6ba-4f2c-9f0a-c11d48354cf3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:04.441942 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7e732862-f6ba-4f2c-9f0a-c11d48354cf3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:04.569340 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-94e1f93f-4f09-490c-9ac7-cfbc9594ceb9 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:04.577684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-94e1f93f-4f09-490c-9ac7-cfbc9594ceb9 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1676 microversion: 2.1 time: 0.242873 Jul 15 15:59:04.578379 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 391/788] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:04 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:04.582488 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7e732862-f6ba-4f2c-9f0a-c11d48354cf3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:04.591790 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7e732862-f6ba-4f2c-9f0a-c11d48354cf3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1723 microversion: 2.1 time: 0.163912 Jul 15 15:59:04.592353 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 398/789] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:04 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:05.186647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-94f1fa69-052f-4bf3-b778-c582787b3d8f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:05.187276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-94f1fa69-052f-4bf3-b778-c582787b3d8f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:05.195261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94f1fa69-052f-4bf3-b778-c582787b3d8f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.196271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94f1fa69-052f-4bf3-b778-c582787b3d8f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.197210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94f1fa69-052f-4bf3-b778-c582787b3d8f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.197647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-94f1fa69-052f-4bf3-b778-c582787b3d8f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.398677 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-94f1fa69-052f-4bf3-b778-c582787b3d8f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:05.412037 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-94f1fa69-052f-4bf3-b778-c582787b3d8f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.229579 Jul 15 15:59:05.412631 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 392/790] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:05 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:05.595649 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dded0e18-9d8d-41d7-85a5-5fb1afa46ca1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:05.596269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dded0e18-9d8d-41d7-85a5-5fb1afa46ca1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:05.603736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dded0e18-9d8d-41d7-85a5-5fb1afa46ca1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.604469 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dded0e18-9d8d-41d7-85a5-5fb1afa46ca1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.605125 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dded0e18-9d8d-41d7-85a5-5fb1afa46ca1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.605565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dded0e18-9d8d-41d7-85a5-5fb1afa46ca1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.609881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-80938669-6577-4469-9816-4b4f51ffa6c8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:05.610579 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-80938669-6577-4469-9816-4b4f51ffa6c8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:05.617531 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80938669-6577-4469-9816-4b4f51ffa6c8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.618770 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80938669-6577-4469-9816-4b4f51ffa6c8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.619700 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80938669-6577-4469-9816-4b4f51ffa6c8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.620215 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80938669-6577-4469-9816-4b4f51ffa6c8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.738290 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-dded0e18-9d8d-41d7-85a5-5fb1afa46ca1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:05.746843 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dded0e18-9d8d-41d7-85a5-5fb1afa46ca1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1653 microversion: 2.1 time: 0.154978 Jul 15 15:59:05.747453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 399/791] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:05 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:05.768869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dc6e3094-cc21-43ee-89c0-c5e82f7638c8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:05.770543 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-80938669-6577-4469-9816-4b4f51ffa6c8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:05.775046 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dc6e3094-cc21-43ee-89c0-c5e82f7638c8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.775594 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dc6e3094-cc21-43ee-89c0-c5e82f7638c8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.782327 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-80938669-6577-4469-9816-4b4f51ffa6c8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1729 microversion: 2.1 time: 0.176674 Jul 15 15:59:05.794006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 393/792] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:05 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:05.797973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dc6e3094-cc21-43ee-89c0-c5e82f7638c8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Going to try to start instance {{(pid=130091) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 15:59:05.799163 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-21856ee4-4401-4b57-b3b3-75c1b1ddae88 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:05.799683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-21856ee4-4401-4b57-b3b3-75c1b1ddae88 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:05.806425 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21856ee4-4401-4b57-b3b3-75c1b1ddae88 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.806875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21856ee4-4401-4b57-b3b3-75c1b1ddae88 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.807679 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21856ee4-4401-4b57-b3b3-75c1b1ddae88 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.808117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21856ee4-4401-4b57-b3b3-75c1b1ddae88 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.885285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-21856ee4-4401-4b57-b3b3-75c1b1ddae88 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089950 Jul 15 15:59:05.885889 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 394/793] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Jul 15 15:59:05 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:05.965531 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dc6e3094-cc21-43ee-89c0-c5e82f7638c8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/action" status: 202 len: 0 microversion: 2.1 time: 0.200186 Jul 15 15:59:05.966148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 400/794] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 15:59:05 2022] POST /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:59:05.974400 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-46f1363f-aaed-45b3-b990-05a2db8cf9db tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:05.975146 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-46f1363f-aaed-45b3-b990-05a2db8cf9db tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:05.982320 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-46f1363f-aaed-45b3-b990-05a2db8cf9db tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.982773 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-46f1363f-aaed-45b3-b990-05a2db8cf9db tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:05.983580 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-46f1363f-aaed-45b3-b990-05a2db8cf9db tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:05.984023 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-46f1363f-aaed-45b3-b990-05a2db8cf9db tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:06.429119 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1f646946-38d6-4827-a1fa-62b4c560ce04 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:06.429935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1f646946-38d6-4827-a1fa-62b4c560ce04 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:06.436509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f646946-38d6-4827-a1fa-62b4c560ce04 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:06.436961 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f646946-38d6-4827-a1fa-62b4c560ce04 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:06.437745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f646946-38d6-4827-a1fa-62b4c560ce04 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:06.438194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1f646946-38d6-4827-a1fa-62b4c560ce04 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:06.466181 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-46f1363f-aaed-45b3-b990-05a2db8cf9db tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:06.474081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-46f1363f-aaed-45b3-b990-05a2db8cf9db tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1662 microversion: 2.1 time: 0.503355 Jul 15 15:59:06.474863 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 395/795] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:05 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1662 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:06.578697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1f646946-38d6-4827-a1fa-62b4c560ce04 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:06.587325 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1f646946-38d6-4827-a1fa-62b4c560ce04 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.161675 Jul 15 15:59:06.588272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 401/796] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:06 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:07.134133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-16c18f3d-690a-4643-aa59-542a7b6225c4 req-395e73d1-ee84-46eb-a150-51f2761a5e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d049f0c3-2447-4627-b276-74454c4f13fe", "tag": "e504616b-d5ea-4a8d-89f2-7ea9f3df5838"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:07.143381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-16c18f3d-690a-4643-aa59-542a7b6225c4 req-395e73d1-ee84-46eb-a150-51f2761a5e7d service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:07.143966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-16c18f3d-690a-4643-aa59-542a7b6225c4 req-395e73d1-ee84-46eb-a150-51f2761a5e7d service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:07.156058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-16c18f3d-690a-4643-aa59-542a7b6225c4 req-395e73d1-ee84-46eb-a150-51f2761a5e7d service nova] Creating event network-changed:e504616b-d5ea-4a8d-89f2-7ea9f3df5838 for instance d049f0c3-2447-4627-b276-74454c4f13fe on hv-cinder-83587 Jul 15 15:59:07.160881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-16c18f3d-690a-4643-aa59-542a7b6225c4 req-395e73d1-ee84-46eb-a150-51f2761a5e7d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030988 Jul 15 15:59:07.161677 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 396/797] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:07.491219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3e44394c-3b6a-46b1-85ab-1262e46353f5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:07.491982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3e44394c-3b6a-46b1-85ab-1262e46353f5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:07.498470 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3e44394c-3b6a-46b1-85ab-1262e46353f5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:07.498923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3e44394c-3b6a-46b1-85ab-1262e46353f5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:07.499732 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3e44394c-3b6a-46b1-85ab-1262e46353f5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:07.500167 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3e44394c-3b6a-46b1-85ab-1262e46353f5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:07.606089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6ba852d5-119d-46fc-ad32-b1b83b44b934 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:07.606808 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6ba852d5-119d-46fc-ad32-b1b83b44b934 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:07.614022 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6ba852d5-119d-46fc-ad32-b1b83b44b934 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:07.614474 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6ba852d5-119d-46fc-ad32-b1b83b44b934 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:07.615264 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6ba852d5-119d-46fc-ad32-b1b83b44b934 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:07.615877 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6ba852d5-119d-46fc-ad32-b1b83b44b934 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:07.637857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3e44394c-3b6a-46b1-85ab-1262e46353f5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:07.645874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3e44394c-3b6a-46b1-85ab-1262e46353f5 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1662 microversion: 2.1 time: 0.158427 Jul 15 15:59:07.649908 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 402/798] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:07 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:07.748572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6ba852d5-119d-46fc-ad32-b1b83b44b934 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:07.756306 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6ba852d5-119d-46fc-ad32-b1b83b44b934 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.155284 Jul 15 15:59:07.756893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 397/799] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:07 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:08.663633 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9543d414-7756-461d-b168-2522d97692d2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:08.664398 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9543d414-7756-461d-b168-2522d97692d2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:08.671271 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9543d414-7756-461d-b168-2522d97692d2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:08.671761 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9543d414-7756-461d-b168-2522d97692d2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:08.672596 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9543d414-7756-461d-b168-2522d97692d2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:08.673028 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9543d414-7756-461d-b168-2522d97692d2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:08.775017 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7e4212ab-a52a-467b-80c8-995f96284911 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:08.775614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7e4212ab-a52a-467b-80c8-995f96284911 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:08.782357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e4212ab-a52a-467b-80c8-995f96284911 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:08.792155 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e4212ab-a52a-467b-80c8-995f96284911 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:08.792155 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e4212ab-a52a-467b-80c8-995f96284911 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:08.792155 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7e4212ab-a52a-467b-80c8-995f96284911 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:08.920369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7e4212ab-a52a-467b-80c8-995f96284911 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:08.927963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7e4212ab-a52a-467b-80c8-995f96284911 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.157710 Jul 15 15:59:08.928548 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 398/800] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:08 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:09.012885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9543d414-7756-461d-b168-2522d97692d2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:09.020511 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9543d414-7756-461d-b168-2522d97692d2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1662 microversion: 2.1 time: 0.360748 Jul 15 15:59:09.021533 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 403/801] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:08 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1662 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:09.176453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-6bfa56c7-7f7a-408c-afdc-b8cc801c9b78 req-25035cfe-5ba1-4cf4-bcb0-bdc7a97960c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d049f0c3-2447-4627-b276-74454c4f13fe", "tag": "e504616b-d5ea-4a8d-89f2-7ea9f3df5838"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:09.185020 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-6bfa56c7-7f7a-408c-afdc-b8cc801c9b78 req-25035cfe-5ba1-4cf4-bcb0-bdc7a97960c2 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:09.185357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-6bfa56c7-7f7a-408c-afdc-b8cc801c9b78 req-25035cfe-5ba1-4cf4-bcb0-bdc7a97960c2 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:09.196518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-6bfa56c7-7f7a-408c-afdc-b8cc801c9b78 req-25035cfe-5ba1-4cf4-bcb0-bdc7a97960c2 service nova] Creating event network-changed:e504616b-d5ea-4a8d-89f2-7ea9f3df5838 for instance d049f0c3-2447-4627-b276-74454c4f13fe on hv-cinder-83587 Jul 15 15:59:09.201425 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-6bfa56c7-7f7a-408c-afdc-b8cc801c9b78 req-25035cfe-5ba1-4cf4-bcb0-bdc7a97960c2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028799 Jul 15 15:59:09.202018 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 399/802] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:09.945259 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1e972a46-71fa-47cc-b276-5179b58458d6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:09.945868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1e972a46-71fa-47cc-b276-5179b58458d6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:09.952277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1e972a46-71fa-47cc-b276-5179b58458d6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:09.952744 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1e972a46-71fa-47cc-b276-5179b58458d6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:09.953489 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1e972a46-71fa-47cc-b276-5179b58458d6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:09.953991 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1e972a46-71fa-47cc-b276-5179b58458d6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:10.038551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-083aed90-93ec-4429-a444-32199d8dbd32 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:10.041216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-083aed90-93ec-4429-a444-32199d8dbd32 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:10.048034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-083aed90-93ec-4429-a444-32199d8dbd32 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:10.048564 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-083aed90-93ec-4429-a444-32199d8dbd32 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:10.049531 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-083aed90-93ec-4429-a444-32199d8dbd32 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:10.050186 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-083aed90-93ec-4429-a444-32199d8dbd32 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:10.086920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1e972a46-71fa-47cc-b276-5179b58458d6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:10.095231 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1e972a46-71fa-47cc-b276-5179b58458d6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.153687 Jul 15 15:59:10.096071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 404/803] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:09 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:10.185089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-083aed90-93ec-4429-a444-32199d8dbd32 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:10.192673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-083aed90-93ec-4429-a444-32199d8dbd32 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1666 microversion: 2.1 time: 0.158735 Jul 15 15:59:10.193250 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 400/804] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:10 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:11.112906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-31adec86-1ea2-417b-a34b-9733fc969a9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:11.113518 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-31adec86-1ea2-417b-a34b-9733fc969a9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:11.121689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31adec86-1ea2-417b-a34b-9733fc969a9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:11.122139 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31adec86-1ea2-417b-a34b-9733fc969a9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:11.122908 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31adec86-1ea2-417b-a34b-9733fc969a9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:11.123372 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31adec86-1ea2-417b-a34b-9733fc969a9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:11.255020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-31adec86-1ea2-417b-a34b-9733fc969a9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:11.262577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-31adec86-1ea2-417b-a34b-9733fc969a9a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.153504 Jul 15 15:59:11.263140 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 405/805] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:11 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:11.605262 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-a3b75c6f-270b-48d3-9270-1da56d851b1c req-6db5e7fc-cf3f-4c3e-94d0-84202ff2dad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415beda2-d5fa-4cbe-99ae-9802fa6a0dfa", "name": "network-vif-plugged", "status": "completed", "tag": "9a4249d9-e236-41ac-8714-1ff0e3f04d17"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:11.613326 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a3b75c6f-270b-48d3-9270-1da56d851b1c req-6db5e7fc-cf3f-4c3e-94d0-84202ff2dad1 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:11.613773 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a3b75c6f-270b-48d3-9270-1da56d851b1c req-6db5e7fc-cf3f-4c3e-94d0-84202ff2dad1 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:11.624465 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-a3b75c6f-270b-48d3-9270-1da56d851b1c req-6db5e7fc-cf3f-4c3e-94d0-84202ff2dad1 service nova] Creating event network-vif-plugged:9a4249d9-e236-41ac-8714-1ff0e3f04d17 for instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa on hv-cinder-83587 Jul 15 15:59:11.629137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-a3b75c6f-270b-48d3-9270-1da56d851b1c req-6db5e7fc-cf3f-4c3e-94d0-84202ff2dad1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082974 Jul 15 15:59:11.629764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 401/806] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:12.279767 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-aa4a183f-cd9e-4698-87ba-de8887d91111 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:12.280299 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-aa4a183f-cd9e-4698-87ba-de8887d91111 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:12.286802 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa4a183f-cd9e-4698-87ba-de8887d91111 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:12.287237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa4a183f-cd9e-4698-87ba-de8887d91111 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:12.288026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa4a183f-cd9e-4698-87ba-de8887d91111 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:12.288455 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-aa4a183f-cd9e-4698-87ba-de8887d91111 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:12.420373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-aa4a183f-cd9e-4698-87ba-de8887d91111 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:12.427870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-aa4a183f-cd9e-4698-87ba-de8887d91111 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.152208 Jul 15 15:59:12.428434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 406/807] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:12 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:13.446324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cdfdaabc-b60b-4125-9a87-4f597e44e21a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:13.447019 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cdfdaabc-b60b-4125-9a87-4f597e44e21a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:13.453789 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cdfdaabc-b60b-4125-9a87-4f597e44e21a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:13.454239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cdfdaabc-b60b-4125-9a87-4f597e44e21a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:13.455004 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cdfdaabc-b60b-4125-9a87-4f597e44e21a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:13.455476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cdfdaabc-b60b-4125-9a87-4f597e44e21a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:13.583352 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cdfdaabc-b60b-4125-9a87-4f597e44e21a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:13.590944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cdfdaabc-b60b-4125-9a87-4f597e44e21a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1368 microversion: 2.1 time: 0.149305 Jul 15 15:59:13.591531 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 402/808] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:13 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:14.608436 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2514175b-b844-4a17-a583-9699a571974a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:14.609053 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2514175b-b844-4a17-a583-9699a571974a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:14.615620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2514175b-b844-4a17-a583-9699a571974a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:14.616073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2514175b-b844-4a17-a583-9699a571974a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:14.616843 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2514175b-b844-4a17-a583-9699a571974a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:14.617284 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2514175b-b844-4a17-a583-9699a571974a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:14.748458 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2514175b-b844-4a17-a583-9699a571974a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:14.755996 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2514175b-b844-4a17-a583-9699a571974a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1556 microversion: 2.1 time: 0.152040 Jul 15 15:59:14.756556 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 407/809] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 15:59:14 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:59:14.772539 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5e128cf6-0040-4729-a0b6-732bd6d3ff63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:14.773090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5e128cf6-0040-4729-a0b6-732bd6d3ff63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:14.780202 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e128cf6-0040-4729-a0b6-732bd6d3ff63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:14.780675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e128cf6-0040-4729-a0b6-732bd6d3ff63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:14.781429 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e128cf6-0040-4729-a0b6-732bd6d3ff63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:14.781858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5e128cf6-0040-4729-a0b6-732bd6d3ff63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:14.860274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5e128cf6-0040-4729-a0b6-732bd6d3ff63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091527 Jul 15 15:59:14.860904 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 403/810] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Jul 15 15:59:14 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:15.836510 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-0887a38c-7e41-443f-bc7f-bc05922dcf01 req-debbaaa0-a6bd-4753-8ef8-17a41ac2b916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415beda2-d5fa-4cbe-99ae-9802fa6a0dfa", "tag": "9a4249d9-e236-41ac-8714-1ff0e3f04d17"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:15.845668 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-0887a38c-7e41-443f-bc7f-bc05922dcf01 req-debbaaa0-a6bd-4753-8ef8-17a41ac2b916 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:15.846119 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-0887a38c-7e41-443f-bc7f-bc05922dcf01 req-debbaaa0-a6bd-4753-8ef8-17a41ac2b916 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:15.857660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-0887a38c-7e41-443f-bc7f-bc05922dcf01 req-debbaaa0-a6bd-4753-8ef8-17a41ac2b916 service nova] Creating event network-changed:9a4249d9-e236-41ac-8714-1ff0e3f04d17 for instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa on hv-cinder-83587 Jul 15 15:59:15.862659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-0887a38c-7e41-443f-bc7f-bc05922dcf01 req-debbaaa0-a6bd-4753-8ef8-17a41ac2b916 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029992 Jul 15 15:59:15.863258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 408/811] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:19.107286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2439191f-7a8d-42bc-b9c8-2ceecaa8a013 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:19.107824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2439191f-7a8d-42bc-b9c8-2ceecaa8a013 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:19.113782 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2439191f-7a8d-42bc-b9c8-2ceecaa8a013 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:19.114234 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2439191f-7a8d-42bc-b9c8-2ceecaa8a013 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:19.114999 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2439191f-7a8d-42bc-b9c8-2ceecaa8a013 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:19.115470 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2439191f-7a8d-42bc-b9c8-2ceecaa8a013 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:19.143614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2439191f-7a8d-42bc-b9c8-2ceecaa8a013 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments/5573a7a6-8722-4e21-ab9e-a0b27ed7b751" status: 200 len: 194 microversion: 2.20 time: 0.138990 Jul 15 15:59:19.144180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 404/812] 10.222.0.98 () {60 vars in 1453 bytes} [Fri Jul 15 15:59:19 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments/5573a7a6-8722-4e21-ab9e-a0b27ed7b751 => generated 194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:59:19.206248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b7f9bb9f-ad17-4849-8812-eff80a274287 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:19.206823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b7f9bb9f-ad17-4849-8812-eff80a274287 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:19.213175 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b7f9bb9f-ad17-4849-8812-eff80a274287 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:19.213625 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b7f9bb9f-ad17-4849-8812-eff80a274287 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:19.214426 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b7f9bb9f-ad17-4849-8812-eff80a274287 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:19.214851 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b7f9bb9f-ad17-4849-8812-eff80a274287 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:19.233041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:19.311141 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-b7f9bb9f-ad17-4849-8812-eff80a274287 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lazy-loading 'services' on Instance uuid 652ce721-72c7-4314-8f15-bf94f30df443 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:59:19.697159 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b7f9bb9f-ad17-4849-8812-eff80a274287 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "DELETE /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments/5573a7a6-8722-4e21-ab9e-a0b27ed7b751" status: 202 len: 0 microversion: 2.20 time: 0.495430 Jul 15 15:59:19.697786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 409/813] 10.222.0.98 () {60 vars in 1456 bytes} [Fri Jul 15 15:59:19 2022] DELETE /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments/5573a7a6-8722-4e21-ab9e-a0b27ed7b751 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:59:19.706351 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1d4f22a9-e840-4a86-8d75-e9aa2cbc01f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:19.707373 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1d4f22a9-e840-4a86-8d75-e9aa2cbc01f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:19.713720 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d4f22a9-e840-4a86-8d75-e9aa2cbc01f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:19.714668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d4f22a9-e840-4a86-8d75-e9aa2cbc01f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:19.715484 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d4f22a9-e840-4a86-8d75-e9aa2cbc01f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:19.715923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d4f22a9-e840-4a86-8d75-e9aa2cbc01f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:19.745192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1d4f22a9-e840-4a86-8d75-e9aa2cbc01f1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042843 Jul 15 15:59:19.745766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 405/814] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Jul 15 15:59:19 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:59:20.758568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-16f90ba9-9ce3-4493-bee3-109848f1b4a3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:20.759637 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-16f90ba9-9ce3-4493-bee3-109848f1b4a3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:20.766786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16f90ba9-9ce3-4493-bee3-109848f1b4a3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:20.767238 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16f90ba9-9ce3-4493-bee3-109848f1b4a3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:20.768033 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16f90ba9-9ce3-4493-bee3-109848f1b4a3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:20.768471 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-16f90ba9-9ce3-4493-bee3-109848f1b4a3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:20.797420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-16f90ba9-9ce3-4493-bee3-109848f1b4a3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043170 Jul 15 15:59:20.797968 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 410/815] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Jul 15 15:59:20 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:59:21.809802 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-88a6d452-d87b-430c-8dfd-fde6576ef6e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:21.810728 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-88a6d452-d87b-430c-8dfd-fde6576ef6e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:21.817303 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-88a6d452-d87b-430c-8dfd-fde6576ef6e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:21.817757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-88a6d452-d87b-430c-8dfd-fde6576ef6e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:21.818520 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-88a6d452-d87b-430c-8dfd-fde6576ef6e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:21.818958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-88a6d452-d87b-430c-8dfd-fde6576ef6e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:21.848059 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-88a6d452-d87b-430c-8dfd-fde6576ef6e0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042763 Jul 15 15:59:21.848616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 406/816] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Jul 15 15:59:21 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:59:21.905615 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8f5d4730-f4fe-4703-a73d-2560ef68acac tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:21.906103 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8f5d4730-f4fe-4703-a73d-2560ef68acac tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:21.912716 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8f5d4730-f4fe-4703-a73d-2560ef68acac tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:21.913172 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8f5d4730-f4fe-4703-a73d-2560ef68acac tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:21.913942 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8f5d4730-f4fe-4703-a73d-2560ef68acac tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:21.914379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8f5d4730-f4fe-4703-a73d-2560ef68acac tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:21.938826 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8f5d4730-f4fe-4703-a73d-2560ef68acac tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:59:22.314682 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8f5d4730-f4fe-4703-a73d-2560ef68acac tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "DELETE /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 204 len: 0 microversion: 2.20 time: 0.412650 Jul 15 15:59:22.315276 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 411/817] 10.222.0.98 () {60 vars in 1279 bytes} [Fri Jul 15 15:59:21 2022] DELETE /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 15:59:22.323495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:22.324111 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:22.330070 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:22.330516 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:22.331274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:22.331733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:22.461441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:22.469869 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:22.471396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:22.472557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cb6a5b16-e9a5-4666-b69c-7acc1fbcae81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.153049 Jul 15 15:59:22.473121 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 407/818] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:22 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:23.491841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:23.492579 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:23.499544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:23.500003 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:23.500775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:23.501364 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:23.645650 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:23.653569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:23.655056 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:23.656227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f2162c4e-6c1c-41b0-a515-b1a91f4e1e9c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.168662 Jul 15 15:59:23.656776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 412/819] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:23 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:24.674350 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:24.674910 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:24.681515 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:24.681964 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:24.682733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:24.683167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:24.819482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:24.828271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:24.829764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:24.830934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2b70817e-5f04-4f20-acc1-faad14320b89 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1723 microversion: 2.20 time: 0.160530 Jul 15 15:59:24.831522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 408/820] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:24 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:25.744874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-dbebc05c-3db1-48aa-b093-82ca493d7937 req-1715805d-3e31-479b-bc59-6c68830b23c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652ce721-72c7-4314-8f15-bf94f30df443", "name": "network-vif-deleted", "tag": "7734477d-4e1a-41e3-bb36-a23f41ac66aa"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:25.753556 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-dbebc05c-3db1-48aa-b093-82ca493d7937 req-1715805d-3e31-479b-bc59-6c68830b23c2 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:25.754067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-dbebc05c-3db1-48aa-b093-82ca493d7937 req-1715805d-3e31-479b-bc59-6c68830b23c2 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:25.766485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-dbebc05c-3db1-48aa-b093-82ca493d7937 req-1715805d-3e31-479b-bc59-6c68830b23c2 service nova] Creating event network-vif-deleted:7734477d-4e1a-41e3-bb36-a23f41ac66aa for instance 652ce721-72c7-4314-8f15-bf94f30df443 on hv-cinder-83587 Jul 15 15:59:25.771374 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-dbebc05c-3db1-48aa-b093-82ca493d7937 req-1715805d-3e31-479b-bc59-6c68830b23c2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091597 Jul 15 15:59:25.771983 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 413/821] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:25.849826 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:25.850561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:25.857187 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:25.857976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:25.858583 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:25.859246 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:25.927066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:25.930701 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:25.943790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:25.943790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:25.944307 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a24f7077-18a8-4cdd-82d8-bfd9229552af tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 200 len: 1655 microversion: 2.20 time: 0.098089 Jul 15 15:59:25.955892 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 409/822] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:25 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:26.964817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:26.965557 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:26.972280 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:26.972726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:26.973539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:26.974126 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:26.994335 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] HTTP exception thrown: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Request method failure captured: Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 HTTP/1.1 Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y15rT1TIsyB6A89MFOty6Zakg8zgEnifp-iXDBQP0iccrXigikyz1BLgJ2WGC555CIHZmLHzHcWOokfrgFvW1D-OdIo1YZYQ175lSNj5WlEZbie2rY0l87a0y-v2XAwpddEHIWhfBm4yGvgQ_MtSCk53noXhDd_HBMh7Xw27e7yldk Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 15:59:26.996018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: ac8dfa5c97594e74a6839d91b292adcd Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 15:59:26.998275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '652ce721-72c7-4314-8f15-bf94f30df443'} Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:59:26.999252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 15:59:27.004607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 15:59:27.006321 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Returning 404 to user: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:59:27.006321 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e7601bf2-04c4-43df-8a5c-ad1ed59f55ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 404 len: 111 microversion: 2.20 time: 0.038208 Jul 15 15:59:27.006321 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 414/823] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:26 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:59:27.007450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f33ee08a-8a73-4f10-b406-e0ec4b44ba8b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '.version_select at 0x7f510f1c4160>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:27.098185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f33ee08a-8a73-4f10-b406-e0ec4b44ba8b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17495743" status: 204 len: 0 microversion: 2.20 time: 0.094606 Jul 15 15:59:27.098783 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 410/824] 10.222.0.98 () {60 vars in 1255 bytes} [Fri Jul 15 15:59:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17495743 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 15:59:27.965723 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a3f96459-efb6-4e26-a768-2686cb84100b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'create', calling method: .version_select at 0x7f510a9ee940>, body: {"keypair": {"name": "tempest-keypair-625398295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4UUX4rxKmd+IqUPUPAm2UQLnH5OGGlm6JFURGB4WcdI7VBQTclv5WXQmg+j8QvkTEPa1vwDjaWcrDRPs0UkWQrW0dutFSyijnQSsg8h+MJk5bE4VOfh7zbGS8sAT3YgQ=="}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:27.979923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-a3f96459-efb6-4e26-a768-2686cb84100b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Getting quotas for project 7df1ad577ddf4dc8a9a75ad1a1337ffe. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:59:27.984383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-a3f96459-efb6-4e26-a768-2686cb84100b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Getting quotas for user ac8dfa5c97594e74a6839d91b292adcd and project 7df1ad577ddf4dc8a9a75ad1a1337ffe. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:59:28.076592 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a3f96459-efb6-4e26-a768-2686cb84100b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.115314 Jul 15 15:59:28.077194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 415/825] 10.222.0.98 () {62 vars in 1199 bytes} [Fri Jul 15 15:59:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 15 15:59:30.619842 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-443698817", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc60fd33-4bb2-4a5e-8f06-fbec56f3f79f"}], "security_groups": [{"name": "tempest-securitygroup--355808295"}], "key_name": "tempest-keypair-625398295", "user_data": "}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:30.720254 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] validate_networks() for [('bc60fd33-4bb2-4a5e-8f06-fbec56f3f79f', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:59:31.084839 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:59:31.085570 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:59:31.086041 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:59:31.086446 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:59:31.086855 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:59:31.096717 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:31.097171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:31.097973 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:31.098405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:31.114934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Getting quotas for project 7df1ad577ddf4dc8a9a75ad1a1337ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:59:31.118928 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Getting quotas for user ac8dfa5c97594e74a6839d91b292adcd and project 7df1ad577ddf4dc8a9a75ad1a1337ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:59:31.130169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:59:31.134402 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:59:31.259212 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c8337f7b-b6c7-46c4-8989-bda896d32afc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.644285 Jul 15 15:59:31.259898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 411/826] 10.222.0.98 () {62 vars in 1187 bytes} [Fri Jul 15 15:59:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 15:59:31.270940 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-252c5b3a-b80d-4daf-8e0e-8c469b2677f3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:31.271580 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-252c5b3a-b80d-4daf-8e0e-8c469b2677f3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:31.332112 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-252c5b3a-b80d-4daf-8e0e-8c469b2677f3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:31.341051 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-252c5b3a-b80d-4daf-8e0e-8c469b2677f3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:31.342696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-252c5b3a-b80d-4daf-8e0e-8c469b2677f3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:31.343974 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-252c5b3a-b80d-4daf-8e0e-8c469b2677f3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1280 microversion: 2.20 time: 0.077497 Jul 15 15:59:31.344659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 416/827] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:31 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:32.362600 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:32.363194 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:32.369371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:32.369822 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:32.370586 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:32.371020 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:32.435577 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:32.443525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:32.445212 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:32.446319 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-990009a2-8a69-4b48-88b1-fe3b1a74a23b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1284 microversion: 2.20 time: 0.088220 Jul 15 15:59:32.446881 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 412/828] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:32 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:33.465475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:33.466091 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:33.475869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:33.476373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:33.477148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:33.477586 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:33.557303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:33.565838 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:33.567377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:33.568481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a6e9f50f-87d5-43b3-8ce8-13b4918ce9bc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1340 microversion: 2.20 time: 0.107142 Jul 15 15:59:33.569177 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 417/829] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:33 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:34.587597 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:34.588220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:34.595248 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:34.595842 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:34.596827 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:34.597029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:34.728292 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:34.736832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:34.738346 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:34.739490 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-27b47b01-e9ff-4aca-a620-4a5ad433a61c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.156035 Jul 15 15:59:34.740061 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 413/830] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:34 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:35.425252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-f2f60623-210b-4104-948c-98bd30ffe44e req-54494a99-26e2-4bbf-8614-d2cec0665dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6551bf2-1fcd-4a78-8a1a-2965321d67cb", "tag": "83f76815-bc46-4425-9b12-ba30c2ba8bd0"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:35.429453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:35.439583 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f2f60623-210b-4104-948c-98bd30ffe44e req-54494a99-26e2-4bbf-8614-d2cec0665dfc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:35.439891 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f2f60623-210b-4104-948c-98bd30ffe44e req-54494a99-26e2-4bbf-8614-d2cec0665dfc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:35.453946 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-f2f60623-210b-4104-948c-98bd30ffe44e req-54494a99-26e2-4bbf-8614-d2cec0665dfc service nova] Creating event network-changed:83f76815-bc46-4425-9b12-ba30c2ba8bd0 for instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb on hv-cinder-83587 Jul 15 15:59:35.458406 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-f2f60623-210b-4104-948c-98bd30ffe44e req-54494a99-26e2-4bbf-8614-d2cec0665dfc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036968 Jul 15 15:59:35.462572 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 418/831] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:35.758252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:35.758992 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:35.761316 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:35.766561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:35.767027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:35.767807 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:35.768248 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:35.901086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:35.909894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:35.911585 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:35.912766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7494c8d2-e2ab-41c2-ae62-c47a07f98ebf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.158491 Jul 15 15:59:35.913340 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 414/832] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:35 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:36.931234 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:36.931876 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:36.938648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:36.939098 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:36.939904 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:36.940378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:37.067480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:37.075419 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:37.077437 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:37.078543 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f5f57d94-acae-4d3a-a9e6-42eabf5d8e1c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.151979 Jul 15 15:59:37.079097 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 419/833] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:36 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:38.096887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:38.097530 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:38.104295 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:38.104747 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:38.105512 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:38.105949 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:38.249749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:38.257583 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:38.259075 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:38.260206 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8a151d5f-7a94-491e-a020-342a9dffaf0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.167194 Jul 15 15:59:38.260773 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 415/834] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:38 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:39.277952 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:39.278547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:39.285684 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:39.286139 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:39.286913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:39.287386 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:39.416795 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:39.424749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:39.426230 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:39.427328 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-35bc0801-564b-4301-b09c-9e250159cc51 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.153247 Jul 15 15:59:39.427879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 420/835] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:39 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:40.445088 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:40.445701 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:40.452205 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:40.452654 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:40.453417 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:40.453853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:40.580116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:40.588124 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:40.589624 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:40.590732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a7e7b10f-ba0f-4d54-bb75-3fb6dce088cb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.149495 Jul 15 15:59:40.591285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 416/836] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:40 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:41.609776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:41.611011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:41.613512 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=6 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:41.618366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:41.618821 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:41.622326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:41.622326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:41.758744 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:41.765992 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:41.767545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:41.768653 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-31da1f1f-0b40-4974-bf39-21033d82141a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.163597 Jul 15 15:59:41.769429 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 421/837] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:41 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:42.786364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:42.786981 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:42.788910 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:42.789696 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=6 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:59:42.794859 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:42.798090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:42.798090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:42.798090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:42.930992 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:42.939770 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:42.941272 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:42.942424 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d026bde9-932b-4b62-bb46-b71d0734023d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.159928 Jul 15 15:59:42.942997 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 417/838] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:42 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:43.824200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-b8619b9e-4fec-4ac5-8bcd-b0bf87fb4e92 req-e4bc7b31-2220-4ac6-be42-62ef7b170738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6551bf2-1fcd-4a78-8a1a-2965321d67cb", "name": "network-vif-plugged", "status": "completed", "tag": "83f76815-bc46-4425-9b12-ba30c2ba8bd0"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:43.833457 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-b8619b9e-4fec-4ac5-8bcd-b0bf87fb4e92 req-e4bc7b31-2220-4ac6-be42-62ef7b170738 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:43.839866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-b8619b9e-4fec-4ac5-8bcd-b0bf87fb4e92 req-e4bc7b31-2220-4ac6-be42-62ef7b170738 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:43.845335 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-b8619b9e-4fec-4ac5-8bcd-b0bf87fb4e92 req-e4bc7b31-2220-4ac6-be42-62ef7b170738 service nova] Creating event network-vif-plugged:83f76815-bc46-4425-9b12-ba30c2ba8bd0 for instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb on hv-cinder-83587 Jul 15 15:59:43.850231 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-b8619b9e-4fec-4ac5-8bcd-b0bf87fb4e92 req-e4bc7b31-2220-4ac6-be42-62ef7b170738 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029761 Jul 15 15:59:43.850827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 422/839] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:59:43.962993 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:43.963665 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:43.970749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:43.971240 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:43.972298 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:43.972502 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:44.102721 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:44.111085 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:44.112847 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:44.113978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dc9d7b87-124c-4ccd-be85-1e1984144efd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.155246 Jul 15 15:59:44.114560 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 418/840] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:43 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:45.133110 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:45.133806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:45.140034 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:45.140490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:45.141257 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:45.141696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:45.271849 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:45.280378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:45.281896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:45.282989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b8e57d3e-4d4f-4247-ad92-e39da4392dcf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.154560 Jul 15 15:59:45.283583 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 423/841] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:45 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:46.300744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:46.301346 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:46.307926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:46.308382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:46.309153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:46.309594 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:46.437779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:46.445695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:46.447198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:46.448336 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b5024dc5-0fa2-4baf-9a18-efd36eccd241 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1405 microversion: 2.20 time: 0.151553 Jul 15 15:59:46.448956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 419/842] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:46 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:47.466926 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:47.467570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:47.474001 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:47.474447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:47.475207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:47.475666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:47.607144 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:47.615724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:47.617229 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:59:47.618418 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3698294a-db26-4c40-84df-90ddf11905c8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1597 microversion: 2.20 time: 0.155297 Jul 15 15:59:47.618980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 424/843] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 15:59:47 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1597 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:59:47.636611 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a94c94d3-3542-449a-b3c0-c74754742909 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:59:47.637203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a94c94d3-3542-449a-b3c0-c74754742909 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:59:47.644137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a94c94d3-3542-449a-b3c0-c74754742909 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:47.644596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a94c94d3-3542-449a-b3c0-c74754742909 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:47.645371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a94c94d3-3542-449a-b3c0-c74754742909 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:47.645812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a94c94d3-3542-449a-b3c0-c74754742909 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:47.725100 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a94c94d3-3542-449a-b3c0-c74754742909 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092399 Jul 15 15:59:47.725706 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 420/844] 10.222.0.98 () {60 vars in 1315 bytes} [Fri Jul 15 15:59:47 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:59:48.972098 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-8fb89570-e4de-42bf-b2b6-509f2a6f7995 req-af0cf5fc-8450-4fec-b0b3-d8f2a93532b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6551bf2-1fcd-4a78-8a1a-2965321d67cb", "tag": "83f76815-bc46-4425-9b12-ba30c2ba8bd0"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:59:48.980076 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-8fb89570-e4de-42bf-b2b6-509f2a6f7995 req-af0cf5fc-8450-4fec-b0b3-d8f2a93532b1 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:59:48.980513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-8fb89570-e4de-42bf-b2b6-509f2a6f7995 req-af0cf5fc-8450-4fec-b0b3-d8f2a93532b1 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:59:48.991815 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-8fb89570-e4de-42bf-b2b6-509f2a6f7995 req-af0cf5fc-8450-4fec-b0b3-d8f2a93532b1 service nova] Creating event network-changed:83f76815-bc46-4425-9b12-ba30c2ba8bd0 for instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb on hv-cinder-83587 Jul 15 15:59:48.996620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-8fb89570-e4de-42bf-b2b6-509f2a6f7995 req-af0cf5fc-8450-4fec-b0b3-d8f2a93532b1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082680 Jul 15 15:59:48.997218 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 425/845] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 15:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:10.656143 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=13 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:10.656919 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=54 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:10.661811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d33a5f87-7de6-46d6-a903-b3934840e030 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1507993191"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:10.661966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d33a5f87-7de6-46d6-a903-b3934840e030 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:10.667923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d33a5f87-7de6-46d6-a903-b3934840e030 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:10.668381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d33a5f87-7de6-46d6-a903-b3934840e030 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:10.669151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d33a5f87-7de6-46d6-a903-b3934840e030 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:10.669590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d33a5f87-7de6-46d6-a903-b3934840e030 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:10.800396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.network.security_group_api [None req-d33a5f87-7de6-46d6-a903-b3934840e030 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Removing security group f3449546-8483-4bb1-848d-1b5d4355c636 from port bb3cde32-0415-4bd3-afe9-b8b361cc5127 Jul 15 16:00:11.202830 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d33a5f87-7de6-46d6-a903-b3934840e030 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "POST /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/action" status: 202 len: 0 microversion: 2.1 time: 0.549089 Jul 15 16:00:11.204149 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 421/846] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 16:00:10 2022] POST /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:00:11.213568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-9b17c854-e3b4-4a55-a61f-bbfbb771c201 req-bd090676-6b26-4b52-9876-79922ab473ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6e6ea2-1ab6-4817-a02f-0c32dadb97b5", "tag": "bb3cde32-0415-4bd3-afe9-b8b361cc5127"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:11.219464 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=15 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:11.220793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:11.226151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-9b17c854-e3b4-4a55-a61f-bbfbb771c201 req-bd090676-6b26-4b52-9876-79922ab473ed service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:11.226900 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-9b17c854-e3b4-4a55-a61f-bbfbb771c201 req-bd090676-6b26-4b52-9876-79922ab473ed service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:11.241294 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-9b17c854-e3b4-4a55-a61f-bbfbb771c201 req-bd090676-6b26-4b52-9876-79922ab473ed service nova] Creating event network-changed:bb3cde32-0415-4bd3-afe9-b8b361cc5127 for instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 on hv-cinder-83587 Jul 15 16:00:11.253502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-9b17c854-e3b4-4a55-a61f-bbfbb771c201 req-bd090676-6b26-4b52-9876-79922ab473ed service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043839 Jul 15 16:00:11.254522 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 426/847] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:12.535708 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-764585a7-d477-4f0b-a2bd-85965c8da490 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:12.536222 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-764585a7-d477-4f0b-a2bd-85965c8da490 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:12.542298 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-764585a7-d477-4f0b-a2bd-85965c8da490 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:12.542750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-764585a7-d477-4f0b-a2bd-85965c8da490 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:12.543554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-764585a7-d477-4f0b-a2bd-85965c8da490 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:12.543995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-764585a7-d477-4f0b-a2bd-85965c8da490 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:12.625796 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-764585a7-d477-4f0b-a2bd-85965c8da490 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lazy-loading 'services' on Instance uuid de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:12.821422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-764585a7-d477-4f0b-a2bd-85965c8da490 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "DELETE /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments/75a8bcd5-53ec-46de-b324-997adec631b1" status: 202 len: 0 microversion: 2.1 time: 0.289899 Jul 15 16:00:12.822122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 422/848] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:00:12 2022] DELETE /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments/75a8bcd5-53ec-46de-b324-997adec631b1 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:00:12.832898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d18ef045-1df2-4e27-8f0c-0dccefac3a0c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:12.834477 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d18ef045-1df2-4e27-8f0c-0dccefac3a0c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:12.843591 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d18ef045-1df2-4e27-8f0c-0dccefac3a0c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:12.844101 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d18ef045-1df2-4e27-8f0c-0dccefac3a0c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:12.844888 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d18ef045-1df2-4e27-8f0c-0dccefac3a0c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:12.845334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d18ef045-1df2-4e27-8f0c-0dccefac3a0c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:12.874499 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d18ef045-1df2-4e27-8f0c-0dccefac3a0c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Jul 15 16:00:12.875062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 427/849] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:00:12 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:13.270487 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-433dda4d-ed2d-4cb6-bcfc-99d33cdd753a req-fb4be9c8-b711-4fe8-987f-e21f1ec77f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6e6ea2-1ab6-4817-a02f-0c32dadb97b5", "tag": "bb3cde32-0415-4bd3-afe9-b8b361cc5127"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:13.279082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-433dda4d-ed2d-4cb6-bcfc-99d33cdd753a req-fb4be9c8-b711-4fe8-987f-e21f1ec77f1b service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:13.280331 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-433dda4d-ed2d-4cb6-bcfc-99d33cdd753a req-fb4be9c8-b711-4fe8-987f-e21f1ec77f1b service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:13.292118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-433dda4d-ed2d-4cb6-bcfc-99d33cdd753a req-fb4be9c8-b711-4fe8-987f-e21f1ec77f1b service nova] Creating event network-changed:bb3cde32-0415-4bd3-afe9-b8b361cc5127 for instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 on hv-cinder-83587 Jul 15 16:00:13.297341 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-433dda4d-ed2d-4cb6-bcfc-99d33cdd753a req-fb4be9c8-b711-4fe8-987f-e21f1ec77f1b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030903 Jul 15 16:00:13.297947 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 423/850] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:13.886240 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a514a640-e3e8-43dd-964d-786c962aaf55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:13.887194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a514a640-e3e8-43dd-964d-786c962aaf55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:13.894485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a514a640-e3e8-43dd-964d-786c962aaf55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:13.894941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a514a640-e3e8-43dd-964d-786c962aaf55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:13.895755 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a514a640-e3e8-43dd-964d-786c962aaf55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:13.896200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a514a640-e3e8-43dd-964d-786c962aaf55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:13.925607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a514a640-e3e8-43dd-964d-786c962aaf55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 Jul 15 16:00:13.926403 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 428/851] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:00:13 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:14.938884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-beab8075-94ff-427c-8c57-5fa5903369e0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:14.939927 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-beab8075-94ff-427c-8c57-5fa5903369e0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:14.946107 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-beab8075-94ff-427c-8c57-5fa5903369e0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:14.946558 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-beab8075-94ff-427c-8c57-5fa5903369e0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:14.947333 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-beab8075-94ff-427c-8c57-5fa5903369e0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:14.947774 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-beab8075-94ff-427c-8c57-5fa5903369e0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:14.975253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-beab8075-94ff-427c-8c57-5fa5903369e0 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041102 Jul 15 16:00:14.975836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 424/852] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:00:14 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 16:00:14.986427 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:14.987000 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:14.993508 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:14.993966 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:14.994731 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:14.995167 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:15.066893 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] HTTP exception thrown: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 is not attached to volume 75a8bcd5-53ec-46de-b324-997adec631b1 Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Request method failure captured: Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments/75a8bcd5-53ec-46de-b324-997adec631b1 HTTP/1.1 Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y39P_BLstPX0NSe2FtpMgETFjAVlc5He4SSRZ8nI7knBF9yph3lo2BfBRbd1WZsOt48-7fOqlYRYMAVeVQpPnuBOM6X7aFUW2uKYOh6Acn4LMAAwzMLcqPqWU_-7RjH-eNqypEwYxsfClkBk6Dh545iULTsGxqSsfwpbiGLAwVERK4 Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 06d54c4865ff45e59526d477accb6cc4 Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-TestMinimumBasicScenario-810265114 Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:00:15.069308 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/06d54c4865ff45e59526d477accb6cc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_06d54c4865ff45e59526d477accb6cc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/06d54c4865ff45e59526d477accb6cc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/06d54c4865ff45e59526d477accb6cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-TestMinimumBasicScenario-810265114 Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 06d54c4865ff45e59526d477accb6cc4 Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-TestMinimumBasicScenario-810265114 Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-TestMinimumBasicScenario-810265114-project Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: bff41a6af0ea495a856fd5603e810d6a Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-TestMinimumBasicScenario-810265114-project Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:00:15.070962 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 is not attached to volume 75a8bcd5-53ec-46de-b324-997adec631b1 Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'server_id': 'de6e6ea2-1ab6-4817-a02f-0c32dadb97b5', 'id': '75a8bcd5-53ec-46de-b324-997adec631b1'} Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 75a8bcd5-53ec-46de-b324-997adec631b1. Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:00:15.071970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 is not attached to volume 75a8bcd5-53ec-46de-b324-997adec631b1 Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 is not attached to volume 75a8bcd5-53ec-46de-b324-997adec631b1 Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:15.073453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Returning 404 to user: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 is not attached to volume 75a8bcd5-53ec-46de-b324-997adec631b1 {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:00:15.074673 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-23e4c37b-6537-4340-b56e-21dad3e2dc39 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "DELETE /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments/75a8bcd5-53ec-46de-b324-997adec631b1" status: 404 len: 154 microversion: 2.1 time: 0.089165 Jul 15 16:00:15.074673 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 429/853] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:00:14 2022] DELETE /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5/os-volume_attachments/75a8bcd5-53ec-46de-b324-997adec631b1 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:00:16.384366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-588bab9c-5d8d-4349-89c5-185962c188d7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:16.385551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-588bab9c-5d8d-4349-89c5-185962c188d7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:16.392118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-588bab9c-5d8d-4349-89c5-185962c188d7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:16.392596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-588bab9c-5d8d-4349-89c5-185962c188d7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:16.393365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-588bab9c-5d8d-4349-89c5-185962c188d7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:16.393796 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-588bab9c-5d8d-4349-89c5-185962c188d7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:16.417973 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-588bab9c-5d8d-4349-89c5-185962c188d7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:00:16.730233 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-588bab9c-5d8d-4349-89c5-185962c188d7 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "DELETE /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 204 len: 0 microversion: 2.1 time: 0.349355 Jul 15 16:00:16.731132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 425/854] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:00:16 2022] DELETE /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:00:16.739022 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e89c7bac-7f8a-4009-8289-8b62553abe65 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:16.739662 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e89c7bac-7f8a-4009-8289-8b62553abe65 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:16.746110 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e89c7bac-7f8a-4009-8289-8b62553abe65 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:16.750045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e89c7bac-7f8a-4009-8289-8b62553abe65 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:16.750045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e89c7bac-7f8a-4009-8289-8b62553abe65 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:16.750045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e89c7bac-7f8a-4009-8289-8b62553abe65 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:16.881565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e89c7bac-7f8a-4009-8289-8b62553abe65 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:16.890003 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e89c7bac-7f8a-4009-8289-8b62553abe65 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1553 microversion: 2.1 time: 0.154219 Jul 15 16:00:16.890599 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 430/855] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:16 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:17.908355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c5ed6686-546c-4d22-809e-dcf260676c55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:17.909081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c5ed6686-546c-4d22-809e-dcf260676c55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:17.915153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c5ed6686-546c-4d22-809e-dcf260676c55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:17.915639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c5ed6686-546c-4d22-809e-dcf260676c55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:17.916409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c5ed6686-546c-4d22-809e-dcf260676c55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:17.916850 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c5ed6686-546c-4d22-809e-dcf260676c55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:18.050800 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c5ed6686-546c-4d22-809e-dcf260676c55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:18.058265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c5ed6686-546c-4d22-809e-dcf260676c55 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1553 microversion: 2.1 time: 0.154858 Jul 15 16:00:18.058837 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 426/856] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:17 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:19.075416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f26e9a28-a88d-4b76-8a7d-2b5c28b230df tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:19.076201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f26e9a28-a88d-4b76-8a7d-2b5c28b230df tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:19.082656 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f26e9a28-a88d-4b76-8a7d-2b5c28b230df tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:19.083107 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f26e9a28-a88d-4b76-8a7d-2b5c28b230df tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:19.083912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f26e9a28-a88d-4b76-8a7d-2b5c28b230df tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:19.084349 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f26e9a28-a88d-4b76-8a7d-2b5c28b230df tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:19.293984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f26e9a28-a88d-4b76-8a7d-2b5c28b230df tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:19.302078 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f26e9a28-a88d-4b76-8a7d-2b5c28b230df tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1553 microversion: 2.1 time: 0.230562 Jul 15 16:00:19.302650 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 431/857] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:19 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:19.641753 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-33d29ec5-6130-4f7e-b5c5-6aff522db39d req-555996f1-d024-44de-a65d-ad34aed291c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6e6ea2-1ab6-4817-a02f-0c32dadb97b5", "name": "network-vif-deleted", "tag": "bb3cde32-0415-4bd3-afe9-b8b361cc5127"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:19.650707 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-33d29ec5-6130-4f7e-b5c5-6aff522db39d req-555996f1-d024-44de-a65d-ad34aed291c9 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:19.651210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-33d29ec5-6130-4f7e-b5c5-6aff522db39d req-555996f1-d024-44de-a65d-ad34aed291c9 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:19.662780 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-33d29ec5-6130-4f7e-b5c5-6aff522db39d req-555996f1-d024-44de-a65d-ad34aed291c9 service nova] Creating event network-vif-deleted:bb3cde32-0415-4bd3-afe9-b8b361cc5127 for instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 on hv-cinder-83587 Jul 15 16:00:19.667547 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-33d29ec5-6130-4f7e-b5c5-6aff522db39d req-555996f1-d024-44de-a65d-ad34aed291c9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030144 Jul 15 16:00:19.668153 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 427/858] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:00:20.318951 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:20.319596 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:20.326175 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:20.326629 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:20.327511 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:20.327991 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:20.359791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:20.360258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:20.360715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lazy-loading 'fault' on Instance uuid de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:20.402463 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff41a6af0ea495a856fd5603e810d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d54c4865ff45e59526d477accb6cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:20.410990 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b5c36d4b-6251-43b4-afe4-8ad6afc417c9 tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 200 len: 1347 microversion: 2.1 time: 0.095822 Jul 15 16:00:20.411606 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 432/859] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:20 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 1347 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:21.428936 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:21.429609 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] [instance: de6e6ea2-1ab6-4817-a02f-0c32dadb97b5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:21.436046 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:21.436495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:21.437275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:21.437709 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:21.450904 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] HTTP exception thrown: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 could not be found. Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Request method failure captured: Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 HTTP/1.1 Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y39P_BLstPX0NSe2FtpMgETFjAVlc5He4SSRZ8nI7knBF9yph3lo2BfBRbd1WZsOt48-7fOqlYRYMAVeVQpPnuBOM6X7aFUW2uKYOh6Acn4LMAAwzMLcqPqWU_-7RjH-eNqypEwYxsfClkBk6Dh545iULTsGxqSsfwpbiGLAwVERK4 Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 06d54c4865ff45e59526d477accb6cc4 Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-TestMinimumBasicScenario-810265114 Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:00:21.452596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/06d54c4865ff45e59526d477accb6cc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_06d54c4865ff45e59526d477accb6cc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/06d54c4865ff45e59526d477accb6cc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/06d54c4865ff45e59526d477accb6cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-TestMinimumBasicScenario-810265114 Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 06d54c4865ff45e59526d477accb6cc4 Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-TestMinimumBasicScenario-810265114 Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-TestMinimumBasicScenario-810265114-project Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: bff41a6af0ea495a856fd5603e810d6a Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-TestMinimumBasicScenario-810265114-project Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 could not be found. Jul 15 16:00:21.455050 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': 'de6e6ea2-1ab6-4817-a02f-0c32dadb97b5'} Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 could not be found. Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:00:21.456116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 could not be found. Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 could not be found. Jul 15 16:00:21.457606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:21.459026 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Returning 404 to user: Instance de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:00:21.459026 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4861ad21-1689-4869-a4e5-4f720d76fa1c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5" status: 404 len: 111 microversion: 2.1 time: 0.030329 Jul 15 16:00:21.459026 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 428/860] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:21 2022] GET /compute/v2.1/servers/de6e6ea2-1ab6-4817-a02f-0c32dadb97b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:00:21.463266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-52d19848-e59f-4b5e-ae55-62707405573c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] Calling method '.version_select at 0x7f510a8e7430>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:21.559652 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-52d19848-e59f-4b5e-ae55-62707405573c tempest-TestMinimumBasicScenario-810265114 tempest-TestMinimumBasicScenario-810265114-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-408088148" status: 202 len: 0 microversion: 2.1 time: 0.100235 Jul 15 16:00:21.560233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 433/861] 10.222.0.98 () {58 vars in 1268 bytes} [Fri Jul 15 16:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-408088148 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:00:23.123431 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-43728ae8-68ba-4fd8-b0b0-35042b1c4c68 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:23.123985 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-43728ae8-68ba-4fd8-b0b0-35042b1c4c68 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:23.130417 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-43728ae8-68ba-4fd8-b0b0-35042b1c4c68 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:23.130875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-43728ae8-68ba-4fd8-b0b0-35042b1c4c68 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:23.131681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-43728ae8-68ba-4fd8-b0b0-35042b1c4c68 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:23.132356 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-43728ae8-68ba-4fd8-b0b0-35042b1c4c68 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:23.213212 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-43728ae8-68ba-4fd8-b0b0-35042b1c4c68 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'services' on Instance uuid d049f0c3-2447-4627-b276-74454c4f13fe {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:23.461376 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-43728ae8-68ba-4fd8-b0b0-35042b1c4c68 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments/3b57fddf-62d5-4a6f-aea4-05cb6694e915" status: 202 len: 0 microversion: 2.1 time: 0.341626 Jul 15 16:00:23.462132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 429/862] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:00:23 2022] DELETE /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments/3b57fddf-62d5-4a6f-aea4-05cb6694e915 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:00:23.472456 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a465e7c5-fe33-4f58-a83c-2e6218959224 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:23.473527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a465e7c5-fe33-4f58-a83c-2e6218959224 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:23.482048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a465e7c5-fe33-4f58-a83c-2e6218959224 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:23.482506 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a465e7c5-fe33-4f58-a83c-2e6218959224 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:23.483334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a465e7c5-fe33-4f58-a83c-2e6218959224 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:23.483778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a465e7c5-fe33-4f58-a83c-2e6218959224 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:23.519420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a465e7c5-fe33-4f58-a83c-2e6218959224 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052253 Jul 15 16:00:23.520162 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 434/863] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:00:23 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:24.532373 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f5614d50-19d8-4b86-a923-c619a343c2c1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:24.534098 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f5614d50-19d8-4b86-a923-c619a343c2c1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:24.540901 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f5614d50-19d8-4b86-a923-c619a343c2c1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:24.541775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f5614d50-19d8-4b86-a923-c619a343c2c1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:24.542858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f5614d50-19d8-4b86-a923-c619a343c2c1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:24.543659 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f5614d50-19d8-4b86-a923-c619a343c2c1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:24.578868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f5614d50-19d8-4b86-a923-c619a343c2c1 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050683 Jul 15 16:00:24.580021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 430/864] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:00:24 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:25.590617 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3629fc36-ea25-4517-a692-36ce35e6ea0f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:25.591592 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3629fc36-ea25-4517-a692-36ce35e6ea0f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:25.598048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3629fc36-ea25-4517-a692-36ce35e6ea0f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:25.598498 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3629fc36-ea25-4517-a692-36ce35e6ea0f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:25.599269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3629fc36-ea25-4517-a692-36ce35e6ea0f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:25.599740 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3629fc36-ea25-4517-a692-36ce35e6ea0f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:25.628896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3629fc36-ea25-4517-a692-36ce35e6ea0f tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042109 Jul 15 16:00:25.629360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 435/865] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:00:25 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 16:00:25.705142 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-00f7171e-b4b6-4288-9e90-eceba38b4d14 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:25.705981 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-00f7171e-b4b6-4288-9e90-eceba38b4d14 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:25.712747 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00f7171e-b4b6-4288-9e90-eceba38b4d14 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:25.713262 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00f7171e-b4b6-4288-9e90-eceba38b4d14 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:25.714106 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00f7171e-b4b6-4288-9e90-eceba38b4d14 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:25.714612 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-00f7171e-b4b6-4288-9e90-eceba38b4d14 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:25.759749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-00f7171e-b4b6-4288-9e90-eceba38b4d14 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:00:26.107498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-00f7171e-b4b6-4288-9e90-eceba38b4d14 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 204 len: 0 microversion: 2.1 time: 0.406359 Jul 15 16:00:26.108109 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 431/866] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:00:25 2022] DELETE /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:00:26.117105 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7ede1482-abdc-49ef-809b-196b597e465e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:26.117863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7ede1482-abdc-49ef-809b-196b597e465e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:26.124506 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7ede1482-abdc-49ef-809b-196b597e465e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:26.125028 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7ede1482-abdc-49ef-809b-196b597e465e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:26.125856 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7ede1482-abdc-49ef-809b-196b597e465e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:26.126355 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7ede1482-abdc-49ef-809b-196b597e465e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:26.388635 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7ede1482-abdc-49ef-809b-196b597e465e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:26.396739 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7ede1482-abdc-49ef-809b-196b597e465e tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1689 microversion: 2.1 time: 0.283623 Jul 15 16:00:26.397313 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 436/867] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:26 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1689 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:27.415398 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8429a0ef-fd0e-4eb2-98c6-0c5655e2a8b3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:27.420772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8429a0ef-fd0e-4eb2-98c6-0c5655e2a8b3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:27.422601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8429a0ef-fd0e-4eb2-98c6-0c5655e2a8b3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:27.423048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8429a0ef-fd0e-4eb2-98c6-0c5655e2a8b3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:27.423839 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8429a0ef-fd0e-4eb2-98c6-0c5655e2a8b3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:27.424269 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8429a0ef-fd0e-4eb2-98c6-0c5655e2a8b3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:27.914014 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8429a0ef-fd0e-4eb2-98c6-0c5655e2a8b3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:27.921918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8429a0ef-fd0e-4eb2-98c6-0c5655e2a8b3 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1689 microversion: 2.1 time: 0.510713 Jul 15 16:00:27.922527 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 432/868] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:27 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1689 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:28.939660 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-84e10713-116d-4b6c-a25a-2f98031cd351 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:28.940203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-84e10713-116d-4b6c-a25a-2f98031cd351 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:28.947090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84e10713-116d-4b6c-a25a-2f98031cd351 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:28.947589 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84e10713-116d-4b6c-a25a-2f98031cd351 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:28.948367 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84e10713-116d-4b6c-a25a-2f98031cd351 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:28.948805 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84e10713-116d-4b6c-a25a-2f98031cd351 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:29.084997 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-84e10713-116d-4b6c-a25a-2f98031cd351 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:29.093125 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-84e10713-116d-4b6c-a25a-2f98031cd351 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1689 microversion: 2.1 time: 0.158363 Jul 15 16:00:29.094446 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 437/869] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:28 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:30.111353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b7ecc1f6-fb4e-44e3-bef5-155dde89ed2c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:30.111994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b7ecc1f6-fb4e-44e3-bef5-155dde89ed2c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:30.120289 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b7ecc1f6-fb4e-44e3-bef5-155dde89ed2c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:30.120936 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b7ecc1f6-fb4e-44e3-bef5-155dde89ed2c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:30.121900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b7ecc1f6-fb4e-44e3-bef5-155dde89ed2c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:30.122672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b7ecc1f6-fb4e-44e3-bef5-155dde89ed2c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:30.347420 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b7ecc1f6-fb4e-44e3-bef5-155dde89ed2c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:30.355116 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b7ecc1f6-fb4e-44e3-bef5-155dde89ed2c tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1689 microversion: 2.1 time: 0.248426 Jul 15 16:00:30.355967 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 433/870] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:30 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:30.689251 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-306d84ee-e56f-4c36-a0f2-f62cfd467635 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:30.691247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-306d84ee-e56f-4c36-a0f2-f62cfd467635 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:30.698094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-306d84ee-e56f-4c36-a0f2-f62cfd467635 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:30.698790 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-306d84ee-e56f-4c36-a0f2-f62cfd467635 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:30.699807 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-306d84ee-e56f-4c36-a0f2-f62cfd467635 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:30.700424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-306d84ee-e56f-4c36-a0f2-f62cfd467635 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:30.735598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-306d84ee-e56f-4c36-a0f2-f62cfd467635 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050993 Jul 15 16:00:30.736191 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 438/871] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:00:30 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 16:00:30.745258 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-d48498b5-436c-4828-b9f5-c69920fbad9c req-02507190-6097-493d-9d9a-4cd9bd678422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d049f0c3-2447-4627-b276-74454c4f13fe", "name": "network-vif-deleted", "tag": "e504616b-d5ea-4a8d-89f2-7ea9f3df5838"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:30.754511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-d48498b5-436c-4828-b9f5-c69920fbad9c req-02507190-6097-493d-9d9a-4cd9bd678422 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:30.754982 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-d48498b5-436c-4828-b9f5-c69920fbad9c req-02507190-6097-493d-9d9a-4cd9bd678422 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:30.767232 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-d48498b5-436c-4828-b9f5-c69920fbad9c req-02507190-6097-493d-9d9a-4cd9bd678422 service nova] Creating event network-vif-deleted:e504616b-d5ea-4a8d-89f2-7ea9f3df5838 for instance d049f0c3-2447-4627-b276-74454c4f13fe on hv-cinder-83587 Jul 15 16:00:30.772386 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-d48498b5-436c-4828-b9f5-c69920fbad9c req-02507190-6097-493d-9d9a-4cd9bd678422 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030846 Jul 15 16:00:30.773590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 434/872] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:00:30.812971 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-85404912-a275-4ec9-a1b1-79afeaf021ac tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:30.813658 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-85404912-a275-4ec9-a1b1-79afeaf021ac tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:30.821192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-85404912-a275-4ec9-a1b1-79afeaf021ac tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:30.821651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-85404912-a275-4ec9-a1b1-79afeaf021ac tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:30.822449 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-85404912-a275-4ec9-a1b1-79afeaf021ac tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:30.822892 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-85404912-a275-4ec9-a1b1-79afeaf021ac tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:30.854526 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-85404912-a275-4ec9-a1b1-79afeaf021ac tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:00:31.227503 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-85404912-a275-4ec9-a1b1-79afeaf021ac tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 204 len: 0 microversion: 2.1 time: 0.418546 Jul 15 16:00:31.228160 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 439/873] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:00:30 2022] DELETE /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:00:31.237705 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-40140dbf-e3a4-412c-923d-244e734f8319 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:31.242269 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-40140dbf-e3a4-412c-923d-244e734f8319 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:31.244753 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-40140dbf-e3a4-412c-923d-244e734f8319 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:31.245143 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-40140dbf-e3a4-412c-923d-244e734f8319 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:31.246122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-40140dbf-e3a4-412c-923d-244e734f8319 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:31.246561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-40140dbf-e3a4-412c-923d-244e734f8319 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:31.373301 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:31.374278 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:31.381682 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:31.382462 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:31.386100 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:31.386783 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:31.420120 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-40140dbf-e3a4-412c-923d-244e734f8319 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:31.423977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:31.428636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-40140dbf-e3a4-412c-923d-244e734f8319 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1672 microversion: 2.1 time: 0.195553 Jul 15 16:00:31.429207 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 435/874] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:31 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:31.444786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:31.445239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:31.445883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'fault' on Instance uuid d049f0c3-2447-4627-b276-74454c4f13fe {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:31.491221 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:31.498768 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-319356f3-d770-4832-9f0b-ef992d8f2d4b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1334 microversion: 2.1 time: 0.129925 Jul 15 16:00:31.499921 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 440/875] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:31 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1334 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:00:32.446820 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-929d2452-3586-4c44-a49f-3e09eef6c1c7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:32.447475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-929d2452-3586-4c44-a49f-3e09eef6c1c7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:32.454389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-929d2452-3586-4c44-a49f-3e09eef6c1c7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:32.454837 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-929d2452-3586-4c44-a49f-3e09eef6c1c7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:32.455646 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-929d2452-3586-4c44-a49f-3e09eef6c1c7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:32.456084 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-929d2452-3586-4c44-a49f-3e09eef6c1c7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:32.516327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:32.517608 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:32.525080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:32.525535 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:32.526332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:32.526769 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:32.564926 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:32.565378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:32.565842 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'fault' on Instance uuid d049f0c3-2447-4627-b276-74454c4f13fe {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:32.569423 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:32.599903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-929d2452-3586-4c44-a49f-3e09eef6c1c7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:32.608609 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-929d2452-3586-4c44-a49f-3e09eef6c1c7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1672 microversion: 2.1 time: 0.165842 Jul 15 16:00:32.610089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 436/876] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:32 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:32.619239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:32.628080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a5f34e0c-b295-4d35-ba53-3ebe5d73bc06 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 200 len: 1334 microversion: 2.1 time: 0.115658 Jul 15 16:00:32.628664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 441/877] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:32 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:00:33.627515 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3fb3d700-f137-41ae-b8f1-28a835980e2e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:33.628261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3fb3d700-f137-41ae-b8f1-28a835980e2e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:33.635437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3fb3d700-f137-41ae-b8f1-28a835980e2e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:33.636285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3fb3d700-f137-41ae-b8f1-28a835980e2e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:33.636815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3fb3d700-f137-41ae-b8f1-28a835980e2e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:33.637332 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3fb3d700-f137-41ae-b8f1-28a835980e2e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:33.647629 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:33.648246 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: d049f0c3-2447-4627-b276-74454c4f13fe] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:33.657562 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:33.658211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:33.663647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:33.663647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:33.677871 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] HTTP exception thrown: Instance d049f0c3-2447-4627-b276-74454c4f13fe could not be found. Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Request method failure captured: Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe HTTP/1.1 Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y10DzbCS3DQTJU_gOOd285DZTxYv1yhcYcCSsQgBFQAGtklPsOguTMShhZJ5Ew7xUEU6GJKnp-xBWPYGp3VznxicKE-i7ZE6HMPq8QSBFfrHO1UjcinhOzqEORciPh99KYHoGPoluej5qLBpDvS1Y3G68GwOhTLuHfT-xYlD-__kA4 Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:00:33.679917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 9005cb23317a4a05b58e99284824135e Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance d049f0c3-2447-4627-b276-74454c4f13fe could not be found. Jul 15 16:00:33.681505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': 'd049f0c3-2447-4627-b276-74454c4f13fe'} Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d049f0c3-2447-4627-b276-74454c4f13fe could not be found. Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:00:33.682434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d049f0c3-2447-4627-b276-74454c4f13fe could not be found. Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d049f0c3-2447-4627-b276-74454c4f13fe could not be found. Jul 15 16:00:33.683989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:33.686534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Returning 404 to user: Instance d049f0c3-2447-4627-b276-74454c4f13fe could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:00:33.688161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6c2df392-ca70-4332-80aa-e709e2020062 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe" status: 404 len: 111 microversion: 2.1 time: 0.044762 Jul 15 16:00:33.689223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 442/878] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:33 2022] GET /compute/v2.1/servers/d049f0c3-2447-4627-b276-74454c4f13fe => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 16:00:33.699777 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2e80151b-f5be-4669-98b5-05e8de68552b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '.version_select at 0x7f510a8f4700>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:33.816920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2e80151b-f5be-4669-98b5-05e8de68552b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894496137" status: 202 len: 0 microversion: 2.1 time: 0.123221 Jul 15 16:00:33.818373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 443/879] 10.222.0.98 () {58 vars in 1217 bytes} [Fri Jul 15 16:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894496137 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 16:00:33.837515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-36c85ba3-5f36-49b4-b3cb-e9a16951198b req-5d5c0181-e9c9-44a6-8fcc-73eaf7b7477b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d25c85d-d076-40e3-81e3-1a9c6a6a1968", "name": "network-vif-deleted", "tag": "fa7b9eab-9027-4963-9a6c-667aa25aa523"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:33.850119 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-36c85ba3-5f36-49b4-b3cb-e9a16951198b req-5d5c0181-e9c9-44a6-8fcc-73eaf7b7477b service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:33.853039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-36c85ba3-5f36-49b4-b3cb-e9a16951198b req-5d5c0181-e9c9-44a6-8fcc-73eaf7b7477b service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:33.877331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-36c85ba3-5f36-49b4-b3cb-e9a16951198b req-5d5c0181-e9c9-44a6-8fcc-73eaf7b7477b service nova] Creating event network-vif-deleted:fa7b9eab-9027-4963-9a6c-667aa25aa523 for instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 on hv-cinder-83587 Jul 15 16:00:33.885941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-36c85ba3-5f36-49b4-b3cb-e9a16951198b req-5d5c0181-e9c9-44a6-8fcc-73eaf7b7477b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065868 Jul 15 16:00:33.886598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 444/880] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:33.897752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3fb3d700-f137-41ae-b8f1-28a835980e2e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:33.910309 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3fb3d700-f137-41ae-b8f1-28a835980e2e tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 200 len: 1605 microversion: 2.1 time: 0.287095 Jul 15 16:00:33.911576 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 437/881] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:33 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 1605 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:34.930100 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:34.931463 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:34.939200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:34.939929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:34.940902 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:34.941509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:34.956470 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] HTTP exception thrown: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Request method failure captured: Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 HTTP/1.1 Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y1511LF_p46wKK5lPQnP9mviJ1x-YV_2kGMRZK8hcX7ajmmSHUVEGa3-Tp2sp_EdLgVGBk-unJCaarXnxlws3i4PxFzwI3TAQWOxuFQrv4iQHd3-3wUnwmY6GbQVEIX-09kMeRxf6kI67exka8zRtmlieza0GoMghOZcoHAM0_eRcg Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:00:34.958133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 78db558bb3ea4161b4a54e62f9ec3bd6 Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:00:34.959804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '5d25c85d-d076-40e3-81e3-1a9c6a6a1968'} Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:00:34.960912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:00:34.962342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:00:34.964130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Returning 404 to user: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:00:34.964130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8b37bca1-9d8e-44d6-b96a-b7b588cc0d66 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 404 len: 111 microversion: 2.1 time: 0.035411 Jul 15 16:00:34.964130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 445/882] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:34 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:00:34.969501 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-92889949-8a4b-4d30-a1ff-ef330707dbbd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '.version_select at 0x7f510f12fee0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:35.063429 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-92889949-8a4b-4d30-a1ff-ef330707dbbd tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508257415" status: 202 len: 0 microversion: 2.1 time: 0.098280 Jul 15 16:00:35.064478 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 438/883] 10.222.0.98 () {58 vars in 1217 bytes} [Fri Jul 15 16:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508257415 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:00:35.910459 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-cec3ae61-df25-4dc0-85a7-daa3629d283a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'create', calling method: .version_select at 0x7f510aa394c0>, body: {"keypair": {"name": "tempest-keypair-177031013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiHkYMZZL/qIRbfIp1e2pdR1wKe8TgRlY0NnPJm3LJL5NdyqC7+vD1j1i9ruFz20JWVr2VYbpnGo1a/RIDjjzRC1eCWZjp13H3g3EWkvt4jPjhghtgIcZOsu72x2eiOBA=="}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:35.924247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-cec3ae61-df25-4dc0-85a7-daa3629d283a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Getting quotas for project 93e4d5ff424c4e4fa5dd81c20cc920d0. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:00:35.928362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-cec3ae61-df25-4dc0-85a7-daa3629d283a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Getting quotas for user 78db558bb3ea4161b4a54e62f9ec3bd6 and project 93e4d5ff424c4e4fa5dd81c20cc920d0. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:00:36.000372 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-cec3ae61-df25-4dc0-85a7-daa3629d283a tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093745 Jul 15 16:00:36.000974 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 446/884] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 16:00:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:37.281702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-71c2e649-1a43-43e3-a7b8-21fd6d210c00 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:37.284132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-71c2e649-1a43-43e3-a7b8-21fd6d210c00 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:37.289511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-71c2e649-1a43-43e3-a7b8-21fd6d210c00 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:37.289963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-71c2e649-1a43-43e3-a7b8-21fd6d210c00 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:37.290819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-71c2e649-1a43-43e3-a7b8-21fd6d210c00 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:37.291258 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-71c2e649-1a43-43e3-a7b8-21fd6d210c00 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:37.316452 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-71c2e649-1a43-43e3-a7b8-21fd6d210c00 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:00:37.582481 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-71c2e649-1a43-43e3-a7b8-21fd6d210c00 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "DELETE /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 204 len: 0 microversion: 2.1 time: 0.304545 Jul 15 16:00:37.583079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 439/885] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:00:37 2022] DELETE /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:00:37.591491 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7a14d6a0-aa5b-4d1e-ab04-8a50b03aa359 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:37.592206 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7a14d6a0-aa5b-4d1e-ab04-8a50b03aa359 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:37.600192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7a14d6a0-aa5b-4d1e-ab04-8a50b03aa359 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:37.600645 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7a14d6a0-aa5b-4d1e-ab04-8a50b03aa359 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:37.601415 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7a14d6a0-aa5b-4d1e-ab04-8a50b03aa359 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:37.601914 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7a14d6a0-aa5b-4d1e-ab04-8a50b03aa359 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:37.818313 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7a14d6a0-aa5b-4d1e-ab04-8a50b03aa359 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:37.825858 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7a14d6a0-aa5b-4d1e-ab04-8a50b03aa359 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1505 microversion: 2.1 time: 0.238520 Jul 15 16:00:37.826419 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 447/886] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:37 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:38.427837 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1606994412", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a36e03ae-e414-4603-bddb-0fccaa84410d"}], "security_groups": [{"name": "tempest-securitygroup--338715498"}], "key_name": "tempest-keypair-177031013", "user_data": "}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:38.532991 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] validate_networks() for [('a36e03ae-e414-4603-bddb-0fccaa84410d', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:00:38.842692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dd497220-83a9-4b8d-91e4-7ac7fd7840d2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:38.843395 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dd497220-83a9-4b8d-91e4-7ac7fd7840d2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:38.849503 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd497220-83a9-4b8d-91e4-7ac7fd7840d2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:38.849775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd497220-83a9-4b8d-91e4-7ac7fd7840d2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:38.850558 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd497220-83a9-4b8d-91e4-7ac7fd7840d2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:38.850996 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd497220-83a9-4b8d-91e4-7ac7fd7840d2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:38.906257 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:00:38.906257 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:00:38.906257 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:00:38.906257 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:00:38.906257 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:00:38.912809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:38.913321 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:38.914203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:38.914843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:38.932126 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Getting quotas for project 93e4d5ff424c4e4fa5dd81c20cc920d0. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:00:38.936267 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Getting quotas for user 78db558bb3ea4161b4a54e62f9ec3bd6 and project 93e4d5ff424c4e4fa5dd81c20cc920d0. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:00:38.948065 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:00:38.950560 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:00:38.980074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-dd497220-83a9-4b8d-91e4-7ac7fd7840d2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:38.988090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dd497220-83a9-4b8d-91e4-7ac7fd7840d2 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1505 microversion: 2.1 time: 0.149753 Jul 15 16:00:38.988661 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 448/887] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:38 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:00:39.092032 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-909bd070-1068-4dcc-9a01-64d5c5d03bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.668885 Jul 15 16:00:39.099822 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 440/888] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:00:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 16:00:39.105512 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3c185565-c1f8-4e20-a3ad-d95b2f598b13 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:39.105719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3c185565-c1f8-4e20-a3ad-d95b2f598b13 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:39.107893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-c6800c89-852c-449e-bcdf-b8dbf48e6fae req-9ade40b4-f6a2-40a8-8fd1-6bb8477157ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340a548f-e53b-443d-a606-fefe96076882", "name": "network-vif-deleted", "tag": "cc489b1f-e51c-4189-a789-13fa2d662f4f"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:39.120995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-c6800c89-852c-449e-bcdf-b8dbf48e6fae req-9ade40b4-f6a2-40a8-8fd1-6bb8477157ed service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:39.121443 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-c6800c89-852c-449e-bcdf-b8dbf48e6fae req-9ade40b4-f6a2-40a8-8fd1-6bb8477157ed service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:39.134112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-c6800c89-852c-449e-bcdf-b8dbf48e6fae req-9ade40b4-f6a2-40a8-8fd1-6bb8477157ed service nova] Creating event network-vif-deleted:cc489b1f-e51c-4189-a789-13fa2d662f4f for instance 340a548f-e53b-443d-a606-fefe96076882 on hv-cinder-83587 Jul 15 16:00:39.145777 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-c6800c89-852c-449e-bcdf-b8dbf48e6fae req-9ade40b4-f6a2-40a8-8fd1-6bb8477157ed service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041525 Jul 15 16:00:39.147152 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 441/889] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:39.174170 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3c185565-c1f8-4e20-a3ad-d95b2f598b13 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:39.182501 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3c185565-c1f8-4e20-a3ad-d95b2f598b13 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1237 microversion: 2.1 time: 0.081347 Jul 15 16:00:39.183403 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 449/890] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:39 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:40.006936 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:40.007744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:40.014008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:40.014459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:40.015314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:40.015730 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:40.045538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:40.046492 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:40.046942 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'fault' on Instance uuid 340a548f-e53b-443d-a606-fefe96076882 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:40.092366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:40.099893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ae2e5d36-a0c4-46b8-a7ed-394eedc78578 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 200 len: 1309 microversion: 2.1 time: 0.097843 Jul 15 16:00:40.100441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 442/891] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:40 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:40.199799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2c949a0d-8d5b-4274-8e67-54d61793a735 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:40.200314 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2c949a0d-8d5b-4274-8e67-54d61793a735 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:40.211522 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2c949a0d-8d5b-4274-8e67-54d61793a735 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:40.211988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2c949a0d-8d5b-4274-8e67-54d61793a735 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:40.212758 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2c949a0d-8d5b-4274-8e67-54d61793a735 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:40.216736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2c949a0d-8d5b-4274-8e67-54d61793a735 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:40.276756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2c949a0d-8d5b-4274-8e67-54d61793a735 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:40.284662 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2c949a0d-8d5b-4274-8e67-54d61793a735 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1241 microversion: 2.1 time: 0.088768 Jul 15 16:00:40.285219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 450/892] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:40 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:41.120298 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:41.120900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 340a548f-e53b-443d-a606-fefe96076882] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:41.123480 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:41.129006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:41.129464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:41.130238 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:41.130672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:41.144963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] HTTP exception thrown: Instance 340a548f-e53b-443d-a606-fefe96076882 could not be found. Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Request method failure captured: Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 HTTP/1.1 Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y10DzbCS3DQTJU_gOOd285DZTxYv1yhcYcCSsQgBFQAGtklPsOguTMShhZJ5Ew7xUEU6GJKnp-xBWPYGp3VznxicKE-i7ZE6HMPq8QSBFfrHO1UjcinhOzqEORciPh99KYHoGPoluej5qLBpDvS1Y3G68GwOhTLuHfT-xYlD-__kA4 Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:00:41.146610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 9005cb23317a4a05b58e99284824135e Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 340a548f-e53b-443d-a606-fefe96076882 could not be found. Jul 15 16:00:41.148294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '340a548f-e53b-443d-a606-fefe96076882'} Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340a548f-e53b-443d-a606-fefe96076882 could not be found. Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:00:41.149171 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340a548f-e53b-443d-a606-fefe96076882 could not be found. Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340a548f-e53b-443d-a606-fefe96076882 could not be found. Jul 15 16:00:41.150462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:41.151549 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Returning 404 to user: Instance 340a548f-e53b-443d-a606-fefe96076882 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:00:41.151549 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3ca3b66b-bc3d-4676-a560-d98599ec1798 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882" status: 404 len: 111 microversion: 2.1 time: 0.031757 Jul 15 16:00:41.151831 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 443/893] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:41 2022] GET /compute/v2.1/servers/340a548f-e53b-443d-a606-fefe96076882 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:00:41.156757 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8e06a9d4-81df-41b9-9197-c77e4007a8d8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:41.158785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8e06a9d4-81df-41b9-9197-c77e4007a8d8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:41.163881 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8e06a9d4-81df-41b9-9197-c77e4007a8d8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:41.164451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8e06a9d4-81df-41b9-9197-c77e4007a8d8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:41.165300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8e06a9d4-81df-41b9-9197-c77e4007a8d8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:41.165811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8e06a9d4-81df-41b9-9197-c77e4007a8d8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:41.194106 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8e06a9d4-81df-41b9-9197-c77e4007a8d8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:00:41.301091 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-078f718c-b601-4028-9f95-7c467dbcbfa1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:41.301809 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-078f718c-b601-4028-9f95-7c467dbcbfa1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:41.308694 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-078f718c-b601-4028-9f95-7c467dbcbfa1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:41.309219 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-078f718c-b601-4028-9f95-7c467dbcbfa1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:41.310118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-078f718c-b601-4028-9f95-7c467dbcbfa1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:41.310623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-078f718c-b601-4028-9f95-7c467dbcbfa1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:41.378221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-078f718c-b601-4028-9f95-7c467dbcbfa1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:41.386029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-078f718c-b601-4028-9f95-7c467dbcbfa1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1307 microversion: 2.1 time: 0.088761 Jul 15 16:00:41.388008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 444/894] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:41 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:00:41.456222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8e06a9d4-81df-41b9-9197-c77e4007a8d8 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "DELETE /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 204 len: 0 microversion: 2.1 time: 0.303078 Jul 15 16:00:41.456919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 451/895] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:00:41 2022] DELETE /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:00:41.465117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ac879996-07dc-4b84-b467-cd853b867f38 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:41.465730 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ac879996-07dc-4b84-b467-cd853b867f38 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:41.472914 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ac879996-07dc-4b84-b467-cd853b867f38 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:41.473459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ac879996-07dc-4b84-b467-cd853b867f38 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:41.474235 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ac879996-07dc-4b84-b467-cd853b867f38 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:41.474700 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ac879996-07dc-4b84-b467-cd853b867f38 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:41.609552 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ac879996-07dc-4b84-b467-cd853b867f38 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:41.617752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ac879996-07dc-4b84-b467-cd853b867f38 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.156293 Jul 15 16:00:41.618351 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 445/896] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:41 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:42.404322 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6c5cd88c-d05b-4f35-9aeb-ae1c9759f63c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:42.405105 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6c5cd88c-d05b-4f35-9aeb-ae1c9759f63c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:42.412698 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c5cd88c-d05b-4f35-9aeb-ae1c9759f63c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:42.413155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c5cd88c-d05b-4f35-9aeb-ae1c9759f63c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:42.413931 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c5cd88c-d05b-4f35-9aeb-ae1c9759f63c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:42.414372 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c5cd88c-d05b-4f35-9aeb-ae1c9759f63c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:42.541954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6c5cd88c-d05b-4f35-9aeb-ae1c9759f63c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:42.549562 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6c5cd88c-d05b-4f35-9aeb-ae1c9759f63c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.149418 Jul 15 16:00:42.550125 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 452/897] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:42 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:42.634900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8543eb89-cbc9-4251-b3ef-0970cf12eb94 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:42.635672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8543eb89-cbc9-4251-b3ef-0970cf12eb94 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:42.643032 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8543eb89-cbc9-4251-b3ef-0970cf12eb94 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:42.643529 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8543eb89-cbc9-4251-b3ef-0970cf12eb94 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:42.644303 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8543eb89-cbc9-4251-b3ef-0970cf12eb94 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:42.644750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8543eb89-cbc9-4251-b3ef-0970cf12eb94 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:42.777094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8543eb89-cbc9-4251-b3ef-0970cf12eb94 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:42.784848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8543eb89-cbc9-4251-b3ef-0970cf12eb94 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.153900 Jul 15 16:00:42.785408 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 446/898] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:42 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:43.565906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6c59bd9f-902d-418f-ab84-d1d70e3679ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:43.566530 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6c59bd9f-902d-418f-ab84-d1d70e3679ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:43.569069 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:43.573867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c59bd9f-902d-418f-ab84-d1d70e3679ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:43.574354 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c59bd9f-902d-418f-ab84-d1d70e3679ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:43.579027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c59bd9f-902d-418f-ab84-d1d70e3679ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:43.579027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6c59bd9f-902d-418f-ab84-d1d70e3679ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:43.760297 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6c59bd9f-902d-418f-ab84-d1d70e3679ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:43.768491 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6c59bd9f-902d-418f-ab84-d1d70e3679ef tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.206432 Jul 15 16:00:43.769059 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 453/899] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:43 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:43.802158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-619d5682-0dd4-468b-8142-c5fbd5403899 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:43.802784 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-619d5682-0dd4-468b-8142-c5fbd5403899 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:43.809957 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-619d5682-0dd4-468b-8142-c5fbd5403899 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:43.810430 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-619d5682-0dd4-468b-8142-c5fbd5403899 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:43.811201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-619d5682-0dd4-468b-8142-c5fbd5403899 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:43.811664 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-619d5682-0dd4-468b-8142-c5fbd5403899 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:43.955177 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-619d5682-0dd4-468b-8142-c5fbd5403899 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:43.965176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-619d5682-0dd4-468b-8142-c5fbd5403899 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1522 microversion: 2.1 time: 0.166930 Jul 15 16:00:43.971345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 447/900] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:43 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:44.166408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-cc653959-6925-4005-a5ea-87a1f1a1b3b1 req-52ac009e-2743-489c-9665-3048c19a75cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "548a2776-957b-44bc-86c1-914102f3da94", "tag": "ffccd932-a128-4971-a815-73234a27c30d"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:44.176825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-cc653959-6925-4005-a5ea-87a1f1a1b3b1 req-52ac009e-2743-489c-9665-3048c19a75cb service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:44.177612 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-cc653959-6925-4005-a5ea-87a1f1a1b3b1 req-52ac009e-2743-489c-9665-3048c19a75cb service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:44.196856 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-cc653959-6925-4005-a5ea-87a1f1a1b3b1 req-52ac009e-2743-489c-9665-3048c19a75cb service nova] Creating event network-changed:ffccd932-a128-4971-a815-73234a27c30d for instance 548a2776-957b-44bc-86c1-914102f3da94 on hv-cinder-83587 Jul 15 16:00:44.202032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-cc653959-6925-4005-a5ea-87a1f1a1b3b1 req-52ac009e-2743-489c-9665-3048c19a75cb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040310 Jul 15 16:00:44.203111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 454/901] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:44.611187 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-d2637864-b31c-4c75-9f3b-6fb2b994d85b req-7d26cbd3-0dd7-40ed-bba3-ade08fd18e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5", "name": "network-vif-deleted", "tag": "e7800a16-36db-4bcb-be6d-391c82f24f64"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:44.620366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-d2637864-b31c-4c75-9f3b-6fb2b994d85b req-7d26cbd3-0dd7-40ed-bba3-ade08fd18e8f service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:44.621029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-d2637864-b31c-4c75-9f3b-6fb2b994d85b req-7d26cbd3-0dd7-40ed-bba3-ade08fd18e8f service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:44.633977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-d2637864-b31c-4c75-9f3b-6fb2b994d85b req-7d26cbd3-0dd7-40ed-bba3-ade08fd18e8f service nova] Creating event network-vif-deleted:e7800a16-36db-4bcb-be6d-391c82f24f64 for instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 on hv-cinder-83587 Jul 15 16:00:44.639190 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-d2637864-b31c-4c75-9f3b-6fb2b994d85b req-7d26cbd3-0dd7-40ed-bba3-ade08fd18e8f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Jul 15 16:00:44.642211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 448/902] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:44.786439 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f7c2e578-5caf-4a8e-83ba-796df415f096 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:44.787251 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f7c2e578-5caf-4a8e-83ba-796df415f096 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:44.794204 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7c2e578-5caf-4a8e-83ba-796df415f096 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:44.794689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7c2e578-5caf-4a8e-83ba-796df415f096 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:44.795502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7c2e578-5caf-4a8e-83ba-796df415f096 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:44.795976 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f7c2e578-5caf-4a8e-83ba-796df415f096 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:44.983905 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:44.984601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:44.991366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:44.992069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:44.993025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:44.993468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:45.025570 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:45.026014 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:45.026513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'fault' on Instance uuid 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:45.042948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f7c2e578-5caf-4a8e-83ba-796df415f096 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:45.052027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f7c2e578-5caf-4a8e-83ba-796df415f096 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.270437 Jul 15 16:00:45.053179 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 455/903] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:44 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:45.070064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:45.078095 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a0d3c32a-fccb-4cb0-b3c5-fd37dfb2d26b tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1312 microversion: 2.1 time: 0.098317 Jul 15 16:00:45.078671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 449/904] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:44 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:46.068575 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-469b5311-835f-447a-9c8c-d76438291730 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:46.069198 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-469b5311-835f-447a-9c8c-d76438291730 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:46.075761 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-469b5311-835f-447a-9c8c-d76438291730 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:46.076218 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-469b5311-835f-447a-9c8c-d76438291730 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:46.077541 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-469b5311-835f-447a-9c8c-d76438291730 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:46.078002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-469b5311-835f-447a-9c8c-d76438291730 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:46.094887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:46.095540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:46.102051 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:46.102510 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:46.103287 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:46.103823 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:46.135692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:46.136238 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:46.136760 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'fault' on Instance uuid 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:46.178017 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:46.185299 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d93c12c0-6d66-4644-b745-1859b4c6f669 tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1312 microversion: 2.1 time: 0.094974 Jul 15 16:00:46.185868 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 450/905] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:46 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:00:46.212741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-469b5311-835f-447a-9c8c-d76438291730 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:46.221785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-469b5311-835f-447a-9c8c-d76438291730 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.157060 Jul 15 16:00:46.222359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 456/906] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:46 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:47.201793 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:47.202475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:47.209021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:47.209464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:47.210222 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:47.210914 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:47.238478 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-79faecb6-3e40-4b50-b483-3bb9df153193 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:47.239117 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-79faecb6-3e40-4b50-b483-3bb9df153193 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:47.243774 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:47.244299 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:47.244669 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lazy-loading 'fault' on Instance uuid 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:00:47.245490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-79faecb6-3e40-4b50-b483-3bb9df153193 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:47.245948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-79faecb6-3e40-4b50-b483-3bb9df153193 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:47.246711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-79faecb6-3e40-4b50-b483-3bb9df153193 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:47.247151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-79faecb6-3e40-4b50-b483-3bb9df153193 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:47.287682 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9005cb23317a4a05b58e99284824135e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cff0ae69e84de486ac2a6866ea6acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:47.295452 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-54364f18-433b-48ba-8319-bd571e2d95ad tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 200 len: 1312 microversion: 2.1 time: 0.097462 Jul 15 16:00:47.296071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 451/907] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:47 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:47.374555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-79faecb6-3e40-4b50-b483-3bb9df153193 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:47.382004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-79faecb6-3e40-4b50-b483-3bb9df153193 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.147393 Jul 15 16:00:47.382573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 457/908] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:47 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:00:48.312510 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:48.313157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] [instance: 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:48.319255 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:48.319759 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:48.320529 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:48.320974 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:48.335163 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] HTTP exception thrown: Instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 could not be found. Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Request method failure captured: Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 HTTP/1.1 Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y10DzbCS3DQTJU_gOOd285DZTxYv1yhcYcCSsQgBFQAGtklPsOguTMShhZJ5Ew7xUEU6GJKnp-xBWPYGp3VznxicKE-i7ZE6HMPq8QSBFfrHO1UjcinhOzqEORciPh99KYHoGPoluej5qLBpDvS1Y3G68GwOhTLuHfT-xYlD-__kA4 Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:00:48.338671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/44cff0ae69e84de486ac2a6866ea6acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 44cff0ae69e84de486ac2a6866ea6acb Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-426065737 Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 9005cb23317a4a05b58e99284824135e Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-ServerRescueNegativeTestJSON-426065737-project Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 could not be found. Jul 15 16:00:48.340056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5'} Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 could not be found. Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:00:48.340779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 could not be found. Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 could not be found. Jul 15 16:00:48.341946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:48.343660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] Returning 404 to user: Instance 1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:00:48.343660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bdb28dc9-e4d9-463c-adda-4e51f053411d tempest-ServerRescueNegativeTestJSON-426065737 tempest-ServerRescueNegativeTestJSON-426065737-project] 10.222.0.98 "GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5" status: 404 len: 111 microversion: 2.1 time: 0.032614 Jul 15 16:00:48.343660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 452/909] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:48 2022] GET /compute/v2.1/servers/1bc12ad7-a3b2-4e29-b9c3-26fd4ade8fc5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:00:48.399015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-878dbe26-8340-4deb-842e-3bf7df60f2d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:48.399794 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-878dbe26-8340-4deb-842e-3bf7df60f2d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:48.410331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-878dbe26-8340-4deb-842e-3bf7df60f2d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:48.411182 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-878dbe26-8340-4deb-842e-3bf7df60f2d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:48.412373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-878dbe26-8340-4deb-842e-3bf7df60f2d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:48.413016 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-878dbe26-8340-4deb-842e-3bf7df60f2d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:48.640620 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-878dbe26-8340-4deb-842e-3bf7df60f2d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:48.647919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-878dbe26-8340-4deb-842e-3bf7df60f2d8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.252696 Jul 15 16:00:48.648477 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 458/910] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:48 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:49.660977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:49.661847 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=6 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:49.666496 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-41d9c4de-1b42-402d-93a2-45b2b9d162de tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:49.667494 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-41d9c4de-1b42-402d-93a2-45b2b9d162de tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:49.676763 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-41d9c4de-1b42-402d-93a2-45b2b9d162de tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:49.677298 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-41d9c4de-1b42-402d-93a2-45b2b9d162de tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:49.678201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-41d9c4de-1b42-402d-93a2-45b2b9d162de tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:49.678739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-41d9c4de-1b42-402d-93a2-45b2b9d162de tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:49.821418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-41d9c4de-1b42-402d-93a2-45b2b9d162de tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:49.825518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:49.830843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-41d9c4de-1b42-402d-93a2-45b2b9d162de tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.170833 Jul 15 16:00:49.831559 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 453/911] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:49 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:50.848592 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f72349a3-a026-432b-bbc1-c947b9951536 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:50.849129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f72349a3-a026-432b-bbc1-c947b9951536 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:50.851378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=6 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:50.856912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f72349a3-a026-432b-bbc1-c947b9951536 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:50.857692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f72349a3-a026-432b-bbc1-c947b9951536 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:50.858697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f72349a3-a026-432b-bbc1-c947b9951536 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:50.859371 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f72349a3-a026-432b-bbc1-c947b9951536 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:51.150613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f72349a3-a026-432b-bbc1-c947b9951536 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:51.161060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f72349a3-a026-432b-bbc1-c947b9951536 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.316319 Jul 15 16:00:51.161682 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 459/912] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:50 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:52.180897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ba492208-fa15-46cb-b9b3-d2c66760ab49 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:52.182688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ba492208-fa15-46cb-b9b3-d2c66760ab49 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:52.198423 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba492208-fa15-46cb-b9b3-d2c66760ab49 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:52.198864 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba492208-fa15-46cb-b9b3-d2c66760ab49 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:52.199701 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba492208-fa15-46cb-b9b3-d2c66760ab49 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:52.200147 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba492208-fa15-46cb-b9b3-d2c66760ab49 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:52.330134 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-9165b6d7-3fad-47c1-ab76-0e63bf02b9b7 req-9661eed2-2761-452b-90a5-87e4c894fb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548a2776-957b-44bc-86c1-914102f3da94", "name": "network-vif-plugged", "status": "completed", "tag": "ffccd932-a128-4971-a815-73234a27c30d"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:52.341120 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-9165b6d7-3fad-47c1-ab76-0e63bf02b9b7 req-9661eed2-2761-452b-90a5-87e4c894fb6c service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:52.341576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-9165b6d7-3fad-47c1-ab76-0e63bf02b9b7 req-9661eed2-2761-452b-90a5-87e4c894fb6c service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:52.353870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-9165b6d7-3fad-47c1-ab76-0e63bf02b9b7 req-9661eed2-2761-452b-90a5-87e4c894fb6c service nova] Creating event network-vif-plugged:ffccd932-a128-4971-a815-73234a27c30d for instance 548a2776-957b-44bc-86c1-914102f3da94 on hv-cinder-83587 Jul 15 16:00:52.359561 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-9165b6d7-3fad-47c1-ab76-0e63bf02b9b7 req-9661eed2-2761-452b-90a5-87e4c894fb6c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033581 Jul 15 16:00:52.363559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 460/913] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:52.464691 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ba492208-fa15-46cb-b9b3-d2c66760ab49 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:52.473390 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ba492208-fa15-46cb-b9b3-d2c66760ab49 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.298705 Jul 15 16:00:52.480517 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 454/914] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:52 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:53.502277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6214fe8a-a280-42fd-a4b3-4420d4a7c45c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:53.502982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6214fe8a-a280-42fd-a4b3-4420d4a7c45c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:53.509215 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6214fe8a-a280-42fd-a4b3-4420d4a7c45c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:53.509672 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6214fe8a-a280-42fd-a4b3-4420d4a7c45c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:53.510449 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6214fe8a-a280-42fd-a4b3-4420d4a7c45c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:53.510888 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6214fe8a-a280-42fd-a4b3-4420d4a7c45c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:53.642236 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6214fe8a-a280-42fd-a4b3-4420d4a7c45c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:53.649677 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6214fe8a-a280-42fd-a4b3-4420d4a7c45c tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1362 microversion: 2.1 time: 0.152084 Jul 15 16:00:53.650247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 461/915] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:53 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:54.667058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0df365f5-c026-40f6-b9e6-6b96a816afc6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:54.667789 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0df365f5-c026-40f6-b9e6-6b96a816afc6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:54.674158 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0df365f5-c026-40f6-b9e6-6b96a816afc6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:54.674676 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0df365f5-c026-40f6-b9e6-6b96a816afc6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:54.675499 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0df365f5-c026-40f6-b9e6-6b96a816afc6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:54.675935 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0df365f5-c026-40f6-b9e6-6b96a816afc6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:54.813433 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0df365f5-c026-40f6-b9e6-6b96a816afc6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:54.821080 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0df365f5-c026-40f6-b9e6-6b96a816afc6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1547 microversion: 2.1 time: 0.157795 Jul 15 16:00:54.821975 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 455/916] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:54 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:54.843246 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fa18e91d-d491-4e8e-b36b-4d94cbb42c39 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:54.843830 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fa18e91d-d491-4e8e-b36b-4d94cbb42c39 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:54.850260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa18e91d-d491-4e8e-b36b-4d94cbb42c39 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:54.857297 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa18e91d-d491-4e8e-b36b-4d94cbb42c39 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:54.857297 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa18e91d-d491-4e8e-b36b-4d94cbb42c39 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:54.857297 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa18e91d-d491-4e8e-b36b-4d94cbb42c39 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:54.932352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fa18e91d-d491-4e8e-b36b-4d94cbb42c39 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093324 Jul 15 16:00:54.932919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 462/917] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Jul 15 16:00:54 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:55.946067 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-288b9b27-b16d-4731-aaab-aa6a91e60124 req-07c33d2b-a458-409a-b50d-b741a7a16d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "548a2776-957b-44bc-86c1-914102f3da94", "tag": "ffccd932-a128-4971-a815-73234a27c30d"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:55.955511 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-288b9b27-b16d-4731-aaab-aa6a91e60124 req-07c33d2b-a458-409a-b50d-b741a7a16d5e service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:55.955953 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-288b9b27-b16d-4731-aaab-aa6a91e60124 req-07c33d2b-a458-409a-b50d-b741a7a16d5e service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:55.968318 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-288b9b27-b16d-4731-aaab-aa6a91e60124 req-07c33d2b-a458-409a-b50d-b741a7a16d5e service nova] Creating event network-changed:ffccd932-a128-4971-a815-73234a27c30d for instance 548a2776-957b-44bc-86c1-914102f3da94 on hv-cinder-83587 Jul 15 16:00:55.973838 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-288b9b27-b16d-4731-aaab-aa6a91e60124 req-07c33d2b-a458-409a-b50d-b741a7a16d5e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031365 Jul 15 16:00:55.974455 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 456/918] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:57.947250 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-642d7bdc-3cb1-40b4-9b12-fae17d4648b3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:57.947831 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-642d7bdc-3cb1-40b4-9b12-fae17d4648b3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:57.953762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-642d7bdc-3cb1-40b4-9b12-fae17d4648b3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:57.954211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-642d7bdc-3cb1-40b4-9b12-fae17d4648b3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:57.955011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-642d7bdc-3cb1-40b4-9b12-fae17d4648b3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:57.955498 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-642d7bdc-3cb1-40b4-9b12-fae17d4648b3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:57.959278 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:00:57.978378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-642d7bdc-3cb1-40b4-9b12-fae17d4648b3 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa/ips" status: 200 len: 148 microversion: 2.1 time: 0.035613 Jul 15 16:00:57.979528 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 463/919] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 16:00:57 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:00:57.990439 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:00:57.991623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:57.998413 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:57.999485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:58.000261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:58.000702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:58.077276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Invalid volume: volume b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c is already attached to instances: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: POST /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa/os-volume_attachments HTTP/1.1 Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 74 Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:00:58.078994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {"volumeAttachment": {"volumeId": "b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c"}} Jul 15 16:00:58.080626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Invalid volume: volume b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c is already attached to instances: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'server_id': '415beda2-d5fa-4cbe-99ae-9802fa6a0dfa', 'body': {'volumeAttachment': {'volumeId': 'b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c'}}} Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c is already attached to instances: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:58.081749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c is already attached to instances: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:00:58.083347 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:00:58.084951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:00:58.084951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:00:58.084951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:00:58.084951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c is already attached to instances: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf Jul 15 16:00:58.084951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:00:58.084951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 400 to user: Invalid volume: volume b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c is already attached to instances: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:00:58.084951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ba37dd8b-4d3a-48c6-90d1-a561d32875d7 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094425 Jul 15 16:00:58.084951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 457/920] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 16:00:57 2022] POST /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 16:00:58.089890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-847999a2-d397-4cb9-a3d3-b517ea809453 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:58.090377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-847999a2-d397-4cb9-a3d3-b517ea809453 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:58.096742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-847999a2-d397-4cb9-a3d3-b517ea809453 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:58.097187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-847999a2-d397-4cb9-a3d3-b517ea809453 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:58.097951 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-847999a2-d397-4cb9-a3d3-b517ea809453 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:58.098385 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-847999a2-d397-4cb9-a3d3-b517ea809453 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:58.122519 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-847999a2-d397-4cb9-a3d3-b517ea809453 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:00:58.386701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-847999a2-d397-4cb9-a3d3-b517ea809453 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 204 len: 0 microversion: 2.1 time: 0.300899 Jul 15 16:00:58.387288 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 464/921] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:00:58 2022] DELETE /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 16:00:58.395446 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-06ccbeaf-02ea-413f-8bf1-9647ba918225 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:58.396066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-06ccbeaf-02ea-413f-8bf1-9647ba918225 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:58.402875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-06ccbeaf-02ea-413f-8bf1-9647ba918225 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:58.403361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-06ccbeaf-02ea-413f-8bf1-9647ba918225 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:58.404135 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-06ccbeaf-02ea-413f-8bf1-9647ba918225 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:58.404577 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-06ccbeaf-02ea-413f-8bf1-9647ba918225 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:58.542293 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-06ccbeaf-02ea-413f-8bf1-9647ba918225 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:58.550616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-06ccbeaf-02ea-413f-8bf1-9647ba918225 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1681 microversion: 2.1 time: 0.159033 Jul 15 16:00:58.551189 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 458/922] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:58 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:00:59.734401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b8c26f4c-525a-44af-a3db-db01917a1699 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:00:59.735224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b8c26f4c-525a-44af-a3db-db01917a1699 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:00:59.741435 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8c26f4c-525a-44af-a3db-db01917a1699 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:59.741877 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8c26f4c-525a-44af-a3db-db01917a1699 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:59.744099 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8c26f4c-525a-44af-a3db-db01917a1699 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:00:59.744099 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8c26f4c-525a-44af-a3db-db01917a1699 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:00:59.877608 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b8c26f4c-525a-44af-a3db-db01917a1699 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:00:59.885196 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b8c26f4c-525a-44af-a3db-db01917a1699 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1681 microversion: 2.1 time: 0.319221 Jul 15 16:00:59.885754 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 465/923] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:00:59 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1681 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:00.903366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0703016f-4e42-4001-9b30-6b9288c9ff6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:00.904129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0703016f-4e42-4001-9b30-6b9288c9ff6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:00.911764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0703016f-4e42-4001-9b30-6b9288c9ff6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:00.912224 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0703016f-4e42-4001-9b30-6b9288c9ff6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:00.913013 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0703016f-4e42-4001-9b30-6b9288c9ff6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:00.913453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0703016f-4e42-4001-9b30-6b9288c9ff6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:01.049956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0703016f-4e42-4001-9b30-6b9288c9ff6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:01.058058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0703016f-4e42-4001-9b30-6b9288c9ff6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1681 microversion: 2.1 time: 0.158624 Jul 15 16:01:01.058639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 459/924] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:00 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:01.622368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-ce74d739-ae31-4583-b429-7d574f78cf27 req-d61a0f54-b532-4554-94ed-4c76a191975f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415beda2-d5fa-4cbe-99ae-9802fa6a0dfa", "name": "network-vif-deleted", "tag": "9a4249d9-e236-41ac-8714-1ff0e3f04d17"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:01.631409 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-ce74d739-ae31-4583-b429-7d574f78cf27 req-d61a0f54-b532-4554-94ed-4c76a191975f service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:01.631858 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-ce74d739-ae31-4583-b429-7d574f78cf27 req-d61a0f54-b532-4554-94ed-4c76a191975f service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:01.646112 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-ce74d739-ae31-4583-b429-7d574f78cf27 req-d61a0f54-b532-4554-94ed-4c76a191975f service nova] Creating event network-vif-deleted:9a4249d9-e236-41ac-8714-1ff0e3f04d17 for instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa on hv-cinder-83587 Jul 15 16:01:01.651135 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-ce74d739-ae31-4583-b429-7d574f78cf27 req-d61a0f54-b532-4554-94ed-4c76a191975f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 Jul 15 16:01:01.652216 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 466/925] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:02.075069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:02.075834 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:02.082565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:02.083125 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:02.084018 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:02.084529 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:02.119141 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:02.119610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:02.120067 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lazy-loading 'fault' on Instance uuid 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:01:02.161518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:02.169464 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-21aa09a9-3222-476e-ae5d-966aca62c04e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 200 len: 1332 microversion: 2.1 time: 0.098370 Jul 15 16:01:02.170042 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 460/926] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:02 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:03.189476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:03.190087 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:03.196501 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:03.196980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:03.197762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:03.198207 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:03.214215 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa HTTP/1.1 Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:01:03.215910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:01:03.217538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '415beda2-d5fa-4cbe-99ae-9802fa6a0dfa'} Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:01:03.218387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:01:03.219875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:03.221058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:01:03.221058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d059928f-1828-4be0-affb-5fda3ae8ed22 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 404 len: 111 microversion: 2.1 time: 0.033836 Jul 15 16:01:03.221058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 467/927] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:03 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:01:03.226376 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-983dc160-6b00-43ae-b40f-a1f0d14010ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '.version_select at 0x7f510a8c81f0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:03.314585 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-983dc160-6b00-43ae-b40f-a1f0d14010ff tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287969267" status: 202 len: 0 microversion: 2.1 time: 0.092024 Jul 15 16:01:03.315167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 461/928] 10.222.0.98 () {58 vars in 1220 bytes} [Fri Jul 15 16:01:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287969267 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:01:04.244964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-92315b9a-2b7e-40c3-9a18-9071388a0105 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:04.245600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-92315b9a-2b7e-40c3-9a18-9071388a0105 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:04.253076 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92315b9a-2b7e-40c3-9a18-9071388a0105 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:04.253534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92315b9a-2b7e-40c3-9a18-9071388a0105 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:04.254316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92315b9a-2b7e-40c3-9a18-9071388a0105 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:04.254760 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92315b9a-2b7e-40c3-9a18-9071388a0105 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:04.334241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-92315b9a-2b7e-40c3-9a18-9071388a0105 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lazy-loading 'services' on Instance uuid 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:01:04.557345 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-92315b9a-2b7e-40c3-9a18-9071388a0105 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments/b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c" status: 202 len: 0 microversion: 2.1 time: 0.316233 Jul 15 16:01:04.557936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 468/929] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:01:04 2022] DELETE /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments/b3960a8f-0a5a-42ae-9c31-68d4d8f67c3c => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:01:04.566819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-246df067-cad8-4baa-ba0e-59077f51fa2c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:04.567900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-246df067-cad8-4baa-ba0e-59077f51fa2c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:04.574820 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-246df067-cad8-4baa-ba0e-59077f51fa2c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:04.575230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-246df067-cad8-4baa-ba0e-59077f51fa2c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:04.576077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-246df067-cad8-4baa-ba0e-59077f51fa2c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:04.576508 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-246df067-cad8-4baa-ba0e-59077f51fa2c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:04.609673 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-246df067-cad8-4baa-ba0e-59077f51fa2c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Jul 15 16:01:04.610238 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 462/930] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:01:04 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:05.626520 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-152966f1-781c-42dd-811e-20dc69cd7113 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:05.627551 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-152966f1-781c-42dd-811e-20dc69cd7113 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:05.633772 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-152966f1-781c-42dd-811e-20dc69cd7113 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:05.634227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-152966f1-781c-42dd-811e-20dc69cd7113 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:05.634993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-152966f1-781c-42dd-811e-20dc69cd7113 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:05.635581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-152966f1-781c-42dd-811e-20dc69cd7113 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:05.666871 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-152966f1-781c-42dd-811e-20dc69cd7113 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Jul 15 16:01:05.667664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 469/931] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:01:05 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:06.679226 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-189ee2ea-405d-437b-96f5-3296180a6bf5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:06.680289 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-189ee2ea-405d-437b-96f5-3296180a6bf5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:06.687494 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-189ee2ea-405d-437b-96f5-3296180a6bf5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:06.687942 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-189ee2ea-405d-437b-96f5-3296180a6bf5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:06.701355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-189ee2ea-405d-437b-96f5-3296180a6bf5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:06.701355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-189ee2ea-405d-437b-96f5-3296180a6bf5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:06.719458 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-189ee2ea-405d-437b-96f5-3296180a6bf5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044208 Jul 15 16:01:06.724747 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 463/932] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:01:06 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 16:01:06.780121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5ae8b6c6-9883-46fc-8ae2-fcb645a3ff08 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:06.780651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5ae8b6c6-9883-46fc-8ae2-fcb645a3ff08 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:06.787058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5ae8b6c6-9883-46fc-8ae2-fcb645a3ff08 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:06.787540 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5ae8b6c6-9883-46fc-8ae2-fcb645a3ff08 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:06.788309 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5ae8b6c6-9883-46fc-8ae2-fcb645a3ff08 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:06.788747 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5ae8b6c6-9883-46fc-8ae2-fcb645a3ff08 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:06.814280 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5ae8b6c6-9883-46fc-8ae2-fcb645a3ff08 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:01:07.140801 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5ae8b6c6-9883-46fc-8ae2-fcb645a3ff08 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 204 len: 0 microversion: 2.1 time: 0.364260 Jul 15 16:01:07.141391 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 470/933] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:01:06 2022] DELETE /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:01:07.149577 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4b586de0-7ce2-4b75-828f-bfab8a6383ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:07.150168 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4b586de0-7ce2-4b75-828f-bfab8a6383ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:07.157473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b586de0-7ce2-4b75-828f-bfab8a6383ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:07.157473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b586de0-7ce2-4b75-828f-bfab8a6383ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:07.157473 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b586de0-7ce2-4b75-828f-bfab8a6383ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:07.157898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b586de0-7ce2-4b75-828f-bfab8a6383ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:07.286409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4b586de0-7ce2-4b75-828f-bfab8a6383ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:07.294013 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4b586de0-7ce2-4b75-828f-bfab8a6383ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1678 microversion: 2.1 time: 0.148265 Jul 15 16:01:07.294573 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 464/934] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:07 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:08.312778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-926dace1-0dc7-450d-a564-b0115011daaa tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:08.313473 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-926dace1-0dc7-450d-a564-b0115011daaa tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:08.319995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-926dace1-0dc7-450d-a564-b0115011daaa tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:08.320448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-926dace1-0dc7-450d-a564-b0115011daaa tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:08.321211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-926dace1-0dc7-450d-a564-b0115011daaa tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:08.321647 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-926dace1-0dc7-450d-a564-b0115011daaa tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:08.452305 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-926dace1-0dc7-450d-a564-b0115011daaa tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:08.459775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-926dace1-0dc7-450d-a564-b0115011daaa tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1678 microversion: 2.1 time: 0.151704 Jul 15 16:01:08.460333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 471/935] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:08 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:09.477536 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c4c9ecbc-d472-4200-8548-42fc499bce02 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:09.478154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c4c9ecbc-d472-4200-8548-42fc499bce02 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:09.485808 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c4c9ecbc-d472-4200-8548-42fc499bce02 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:09.490233 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c4c9ecbc-d472-4200-8548-42fc499bce02 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:09.490233 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c4c9ecbc-d472-4200-8548-42fc499bce02 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:09.490233 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c4c9ecbc-d472-4200-8548-42fc499bce02 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:09.643674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c4c9ecbc-d472-4200-8548-42fc499bce02 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:09.652233 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c4c9ecbc-d472-4200-8548-42fc499bce02 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1678 microversion: 2.1 time: 0.178322 Jul 15 16:01:09.662745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 465/936] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:09 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:10.315248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-2b104831-42bd-4b6d-80c0-fb856dec889e req-334e604f-300f-473f-9b15-2e6c6f9b9ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ed846f-5dcd-4d82-9aef-bd786bf6a6cf", "name": "network-vif-deleted", "tag": "15a05a60-9557-46ed-a4b2-d512781fa87a"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:10.323002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-2b104831-42bd-4b6d-80c0-fb856dec889e req-334e604f-300f-473f-9b15-2e6c6f9b9ca6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:10.323500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-2b104831-42bd-4b6d-80c0-fb856dec889e req-334e604f-300f-473f-9b15-2e6c6f9b9ca6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:10.335274 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-2b104831-42bd-4b6d-80c0-fb856dec889e req-334e604f-300f-473f-9b15-2e6c6f9b9ca6 service nova] Creating event network-vif-deleted:15a05a60-9557-46ed-a4b2-d512781fa87a for instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf on hv-cinder-83587 Jul 15 16:01:10.340396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-2b104831-42bd-4b6d-80c0-fb856dec889e req-334e604f-300f-473f-9b15-2e6c6f9b9ca6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 Jul 15 16:01:10.340980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 472/937] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:10.669987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:10.671391 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:10.679538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:10.680329 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:10.681212 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:10.681767 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:10.728145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:10.728145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:10.728583 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lazy-loading 'fault' on Instance uuid 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:01:10.771461 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:10.779203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9be27c0f-1ba8-43ed-9ff3-119e5203f1f5 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 200 len: 1331 microversion: 2.1 time: 0.113096 Jul 15 16:01:10.779888 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 466/938] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:10 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:11.797992 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:11.798689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:11.804886 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:11.805333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:11.806097 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:11.806532 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:11.821310 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf HTTP/1.1 Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:01:11.822890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:01:11.824545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '03ed846f-5dcd-4d82-9aef-bd786bf6a6cf'} Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:01:11.825726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:01:11.827865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:01:11.829368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:01:11.829368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ce9ba14d-049f-4c15-a36d-7eae09bd3d62 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 404 len: 111 microversion: 2.1 time: 0.031756 Jul 15 16:01:11.829368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 473/939] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:11 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:01:11.833496 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bbd6976d-1d3f-47c2-947a-cd81e1f3c807 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '.version_select at 0x7f510f20b9d0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:11.839426 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:11.901950 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bbd6976d-1d3f-47c2-947a-cd81e1f3c807 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569657272" status: 202 len: 0 microversion: 2.1 time: 0.072130 Jul 15 16:01:11.902534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 467/940] 10.222.0.98 () {58 vars in 1220 bytes} [Fri Jul 15 16:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569657272 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 16:01:12.922094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-22f45315-cd49-4bf7-9f35-3a54f5b51b2b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: .version_select at 0x7f510a8660d0>, body: {"keypair": {"name": "tempest-keypair-1147808282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxOpdBn5Gtvf9GOnpLacBcj3i+ez+vW3qU2ouCH2a01VTXPsMafWaW7vgNSkBF5lryASaHP4VZu9f6cwZuNhgB1pJ0t2lDipF/7AXmOyA8TINChNk/WNIVcPO28AfH/RQ=="}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:12.936182 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-22f45315-cd49-4bf7-9f35-3a54f5b51b2b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for project c35d3e93d36040bba1bbb873e61d239a. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:01:12.940551 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-22f45315-cd49-4bf7-9f35-3a54f5b51b2b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for user 1157b91a306540dd98a072b1ea4941b2 and project c35d3e93d36040bba1bbb873e61d239a. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:01:13.022340 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-22f45315-cd49-4bf7-9f35-3a54f5b51b2b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104646 Jul 15 16:01:13.022927 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 474/941] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 16:01:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:15.446790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1188573152", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0ec6ba6-6b6c-449a-8ed1-834796a501b5"}], "security_groups": [{"name": "tempest-securitygroup--441119550"}], "key_name": "tempest-keypair-1147808282", "user_data": "}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:15.548428 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] validate_networks() for [('a0ec6ba6-6b6c-449a-8ed1-834796a501b5', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:01:15.909422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:01:15.909852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:01:15.910360 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:01:15.910775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:01:15.911192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:01:15.920141 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:15.920596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:15.921934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:15.922376 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:15.939819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for project c35d3e93d36040bba1bbb873e61d239a. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:01:15.943772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for user 1157b91a306540dd98a072b1ea4941b2 and project c35d3e93d36040bba1bbb873e61d239a. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:01:15.954748 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:01:15.957014 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:01:16.125261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c01952a9-b414-48dc-b46f-45ee8097d72e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.683384 Jul 15 16:01:16.126662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 468/942] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:01:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 16:01:16.136713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e341f318-1ebe-4ffe-8062-2959dcdce720 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:16.137814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e341f318-1ebe-4ffe-8062-2959dcdce720 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:16.140047 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:16.197226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e341f318-1ebe-4ffe-8062-2959dcdce720 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:16.204305 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e341f318-1ebe-4ffe-8062-2959dcdce720 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1242 microversion: 2.1 time: 0.072024 Jul 15 16:01:16.205382 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 475/943] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:16 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:17.221988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a4bdc318-7343-4f3d-8d51-b79108cde7c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:17.222636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a4bdc318-7343-4f3d-8d51-b79108cde7c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:17.231932 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a4bdc318-7343-4f3d-8d51-b79108cde7c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:17.241380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a4bdc318-7343-4f3d-8d51-b79108cde7c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:17.241380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a4bdc318-7343-4f3d-8d51-b79108cde7c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:17.241380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a4bdc318-7343-4f3d-8d51-b79108cde7c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:17.301209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a4bdc318-7343-4f3d-8d51-b79108cde7c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:17.308702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a4bdc318-7343-4f3d-8d51-b79108cde7c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1246 microversion: 2.1 time: 0.091040 Jul 15 16:01:17.309273 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 469/944] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:17 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:18.325750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7242f367-5fc5-42c5-bab3-2825c84300b0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:18.326464 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7242f367-5fc5-42c5-bab3-2825c84300b0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:18.333487 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7242f367-5fc5-42c5-bab3-2825c84300b0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:18.338509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7242f367-5fc5-42c5-bab3-2825c84300b0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:18.338509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7242f367-5fc5-42c5-bab3-2825c84300b0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:18.338509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7242f367-5fc5-42c5-bab3-2825c84300b0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:18.399990 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7242f367-5fc5-42c5-bab3-2825c84300b0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:18.408360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7242f367-5fc5-42c5-bab3-2825c84300b0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1294 microversion: 2.1 time: 0.086436 Jul 15 16:01:18.409302 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 476/945] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:18 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:18.523263 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c74814f0-8c2c-40de-bb20-4311032a853e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:18.523830 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c74814f0-8c2c-40de-bb20-4311032a853e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:18.530218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c74814f0-8c2c-40de-bb20-4311032a853e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:18.531168 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c74814f0-8c2c-40de-bb20-4311032a853e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:18.532008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c74814f0-8c2c-40de-bb20-4311032a853e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:18.532448 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c74814f0-8c2c-40de-bb20-4311032a853e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:18.556953 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c74814f0-8c2c-40de-bb20-4311032a853e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/ips" status: 200 len: 151 microversion: 2.20 time: 0.037815 Jul 15 16:01:18.557541 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 470/946] 10.222.0.98 () {60 vars in 1288 bytes} [Fri Jul 15 16:01:18 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 16:01:19.431137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-52b699ee-b625-434c-b408-7fe3e4924379 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:19.431861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-52b699ee-b625-434c-b408-7fe3e4924379 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:19.442324 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-52b699ee-b625-434c-b408-7fe3e4924379 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:19.442787 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-52b699ee-b625-434c-b408-7fe3e4924379 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:19.443608 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-52b699ee-b625-434c-b408-7fe3e4924379 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:19.444051 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-52b699ee-b625-434c-b408-7fe3e4924379 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:19.614498 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-52b699ee-b625-434c-b408-7fe3e4924379 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:19.624892 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-52b699ee-b625-434c-b408-7fe3e4924379 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.199655 Jul 15 16:01:19.626216 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 477/947] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:19 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:20.643046 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ee132e8c-4d6e-4f54-932d-797f11d3005c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:20.643728 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ee132e8c-4d6e-4f54-932d-797f11d3005c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:20.646572 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-2a7e6753-c1fc-4c91-9a02-a61276164b53 req-06d52e54-28af-485b-a803-7b4ea83b07ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd957115-e1c8-4716-82fa-73ca85975a93", "tag": "9bd50bc2-c176-4cb7-a0a2-6b8557815227"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:20.650485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee132e8c-4d6e-4f54-932d-797f11d3005c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:20.651245 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee132e8c-4d6e-4f54-932d-797f11d3005c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:20.652323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee132e8c-4d6e-4f54-932d-797f11d3005c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:20.653093 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee132e8c-4d6e-4f54-932d-797f11d3005c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:20.656069 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-2a7e6753-c1fc-4c91-9a02-a61276164b53 req-06d52e54-28af-485b-a803-7b4ea83b07ca service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:20.656521 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-2a7e6753-c1fc-4c91-9a02-a61276164b53 req-06d52e54-28af-485b-a803-7b4ea83b07ca service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:20.670936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-2a7e6753-c1fc-4c91-9a02-a61276164b53 req-06d52e54-28af-485b-a803-7b4ea83b07ca service nova] Creating event network-changed:9bd50bc2-c176-4cb7-a0a2-6b8557815227 for instance bd957115-e1c8-4716-82fa-73ca85975a93 on hv-cinder-83587 Jul 15 16:01:20.676824 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-2a7e6753-c1fc-4c91-9a02-a61276164b53 req-06d52e54-28af-485b-a803-7b4ea83b07ca service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034593 Jul 15 16:01:20.677356 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 478/948] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:01:20.837981 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ee132e8c-4d6e-4f54-932d-797f11d3005c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:20.846335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ee132e8c-4d6e-4f54-932d-797f11d3005c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.208047 Jul 15 16:01:20.851540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 471/949] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:20 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:21.693791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-bc772af0-3c29-4667-88e7-d771e3ac7781 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:21.694417 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-bc772af0-3c29-4667-88e7-d771e3ac7781 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:21.701177 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bc772af0-3c29-4667-88e7-d771e3ac7781 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:21.701630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bc772af0-3c29-4667-88e7-d771e3ac7781 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:21.702935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bc772af0-3c29-4667-88e7-d771e3ac7781 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:21.703406 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-bc772af0-3c29-4667-88e7-d771e3ac7781 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:21.726713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-bc772af0-3c29-4667-88e7-d771e3ac7781 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lazy-loading 'flavor' on Instance uuid f6551bf2-1fcd-4a78-8a1a-2965321d67cb {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:01:21.862733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-234dfe93-798e-4eac-bb1c-7e52725ded0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:21.863382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-234dfe93-798e-4eac-bb1c-7e52725ded0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:21.869895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-234dfe93-798e-4eac-bb1c-7e52725ded0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:21.870374 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-234dfe93-798e-4eac-bb1c-7e52725ded0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:21.871156 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-234dfe93-798e-4eac-bb1c-7e52725ded0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:21.871624 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-234dfe93-798e-4eac-bb1c-7e52725ded0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:21.968980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:21.999018 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-234dfe93-798e-4eac-bb1c-7e52725ded0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:22.007041 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-234dfe93-798e-4eac-bb1c-7e52725ded0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.148128 Jul 15 16:01:22.008036 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 472/950] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:21 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:01:22.335194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-bc772af0-3c29-4667-88e7-d771e3ac7781 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/action" status: 202 len: 0 microversion: 2.20 time: 0.645476 Jul 15 16:01:22.336146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 479/951] 10.222.0.98 () {62 vars in 1318 bytes} [Fri Jul 15 16:01:21 2022] POST /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:01:22.344718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:22.345338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:22.351666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:22.352123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:22.352894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:22.353334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:22.355960 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=97 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:22.520654 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:22.528480 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:22.530019 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:22.531195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-200a2578-ef03-448c-b684-468856bf4b73 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.190924 Jul 15 16:01:22.532362 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 473/952] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:22 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:23.028627 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4e52b8ce-725e-4720-9599-6fc2554a0570 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:23.029361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4e52b8ce-725e-4720-9599-6fc2554a0570 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:23.036563 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e52b8ce-725e-4720-9599-6fc2554a0570 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:23.037017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e52b8ce-725e-4720-9599-6fc2554a0570 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:23.037790 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e52b8ce-725e-4720-9599-6fc2554a0570 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:23.038289 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4e52b8ce-725e-4720-9599-6fc2554a0570 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:23.165990 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4e52b8ce-725e-4720-9599-6fc2554a0570 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:23.173465 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4e52b8ce-725e-4720-9599-6fc2554a0570 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.149926 Jul 15 16:01:23.174023 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 480/953] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:23 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:23.550016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:23.550625 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:23.557195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:23.557643 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:23.558409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:23.558848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:23.686150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:23.694542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:23.696107 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:23.697304 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f5d63d93-0f43-4f60-a0b0-37ac86485e87 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.151234 Jul 15 16:01:23.697860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 474/954] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:23 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:24.190294 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-13aa8ca5-5ea3-4584-987a-bc104c5e5b34 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:24.191011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-13aa8ca5-5ea3-4584-987a-bc104c5e5b34 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:24.197403 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-13aa8ca5-5ea3-4584-987a-bc104c5e5b34 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:24.197853 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-13aa8ca5-5ea3-4584-987a-bc104c5e5b34 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:24.198624 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-13aa8ca5-5ea3-4584-987a-bc104c5e5b34 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:24.199059 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-13aa8ca5-5ea3-4584-987a-bc104c5e5b34 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:24.339436 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-13aa8ca5-5ea3-4584-987a-bc104c5e5b34 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:24.347695 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-13aa8ca5-5ea3-4584-987a-bc104c5e5b34 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.161671 Jul 15 16:01:24.349019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 481/955] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:24 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:24.716533 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:24.717144 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:24.724204 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:24.724649 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:24.725417 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:24.725848 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:24.863057 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:24.871083 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:24.872617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:24.873787 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bb20f4a4-8fa7-45f3-ab6c-7195e17c5f4e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.161180 Jul 15 16:01:24.874381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 475/956] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:24 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:25.364318 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1800a800-2976-42b8-a7c4-4180ece5c08b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:25.364927 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1800a800-2976-42b8-a7c4-4180ece5c08b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:25.371502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1800a800-2976-42b8-a7c4-4180ece5c08b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:25.371946 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1800a800-2976-42b8-a7c4-4180ece5c08b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:25.372703 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1800a800-2976-42b8-a7c4-4180ece5c08b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:25.373135 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1800a800-2976-42b8-a7c4-4180ece5c08b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:25.498916 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1800a800-2976-42b8-a7c4-4180ece5c08b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:25.507012 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1800a800-2976-42b8-a7c4-4180ece5c08b tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.146422 Jul 15 16:01:25.507616 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 482/957] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:25 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:25.891404 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:25.892021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:25.898674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:25.899141 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:25.899965 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:25.900407 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:25.931568 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:25.950525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=6 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:26.034844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:26.042860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:26.044503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:26.045711 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-20fba543-2372-4ffb-ace9-d7653ec3e5dd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.158398 Jul 15 16:01:26.046281 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 476/958] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:25 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:26.524006 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e04c01da-acdc-4f56-a9e9-7c9d49b490ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:26.524626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e04c01da-acdc-4f56-a9e9-7c9d49b490ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:26.526672 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=6 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:26.531794 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e04c01da-acdc-4f56-a9e9-7c9d49b490ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:26.532253 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e04c01da-acdc-4f56-a9e9-7c9d49b490ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:26.533030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e04c01da-acdc-4f56-a9e9-7c9d49b490ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:26.533472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e04c01da-acdc-4f56-a9e9-7c9d49b490ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:26.678222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e04c01da-acdc-4f56-a9e9-7c9d49b490ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:26.685639 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e04c01da-acdc-4f56-a9e9-7c9d49b490ba tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.165593 Jul 15 16:01:26.686290 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 483/959] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:26 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:27.064865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:27.065475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:27.072205 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:27.072657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:27.073432 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:27.073869 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:27.207622 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:27.221405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:27.221405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:27.221405 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-166252cc-a67e-4b8c-99ed-e2d607f32969 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.158418 Jul 15 16:01:27.221873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 477/960] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:27 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:27.704028 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-51b4fc86-6457-4350-a96d-9e3bd8b66b53 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:27.704645 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-51b4fc86-6457-4350-a96d-9e3bd8b66b53 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:27.711363 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-51b4fc86-6457-4350-a96d-9e3bd8b66b53 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:27.711822 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-51b4fc86-6457-4350-a96d-9e3bd8b66b53 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:27.712587 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-51b4fc86-6457-4350-a96d-9e3bd8b66b53 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:27.713023 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-51b4fc86-6457-4350-a96d-9e3bd8b66b53 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:27.841520 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-51b4fc86-6457-4350-a96d-9e3bd8b66b53 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:27.849562 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-51b4fc86-6457-4350-a96d-9e3bd8b66b53 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.150250 Jul 15 16:01:27.850128 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 484/961] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:27 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:28.237325 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:28.237973 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:28.244622 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:28.245125 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:28.245896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:28.246342 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:28.381162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:28.391381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:28.392926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:28.394105 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-80b30653-8b9d-4cbb-9f8e-c278693313b6 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.160773 Jul 15 16:01:28.394670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 478/962] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:28 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:28.439844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-f4f7cc3e-bf0a-4891-a03d-00d73f357222 req-9d149f00-592b-4701-ac1d-7d6d211cc34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd957115-e1c8-4716-82fa-73ca85975a93", "name": "network-vif-plugged", "status": "completed", "tag": "9bd50bc2-c176-4cb7-a0a2-6b8557815227"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:28.448718 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f4f7cc3e-bf0a-4891-a03d-00d73f357222 req-9d149f00-592b-4701-ac1d-7d6d211cc34f service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:28.449167 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f4f7cc3e-bf0a-4891-a03d-00d73f357222 req-9d149f00-592b-4701-ac1d-7d6d211cc34f service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:28.461361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-f4f7cc3e-bf0a-4891-a03d-00d73f357222 req-9d149f00-592b-4701-ac1d-7d6d211cc34f service nova] Creating event network-vif-plugged:9bd50bc2-c176-4cb7-a0a2-6b8557815227 for instance bd957115-e1c8-4716-82fa-73ca85975a93 on hv-cinder-83587 Jul 15 16:01:28.466480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-f4f7cc3e-bf0a-4891-a03d-00d73f357222 req-9d149f00-592b-4701-ac1d-7d6d211cc34f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031915 Jul 15 16:01:28.467062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 485/963] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:28.866660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ed0ae677-c6fc-4243-b1f9-cd2a6dc1af14 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:28.867683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ed0ae677-c6fc-4243-b1f9-cd2a6dc1af14 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:28.874140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ed0ae677-c6fc-4243-b1f9-cd2a6dc1af14 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:28.874593 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ed0ae677-c6fc-4243-b1f9-cd2a6dc1af14 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:28.875443 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ed0ae677-c6fc-4243-b1f9-cd2a6dc1af14 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:28.875880 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ed0ae677-c6fc-4243-b1f9-cd2a6dc1af14 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:29.015680 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ed0ae677-c6fc-4243-b1f9-cd2a6dc1af14 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:29.023199 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ed0ae677-c6fc-4243-b1f9-cd2a6dc1af14 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.160544 Jul 15 16:01:29.023807 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 479/964] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:28 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:29.413291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:29.413977 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:29.420622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:29.421071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:29.421832 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:29.422264 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:29.554889 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:29.564005 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:29.565757 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:29.566922 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e98f45e3-8876-485f-8374-d2ee00c55e42 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.157976 Jul 15 16:01:29.567525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 486/965] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:29 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 16:01:30.041413 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-44d58684-616a-4b0d-a625-1c4f548a2d8c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:30.042080 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-44d58684-616a-4b0d-a625-1c4f548a2d8c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:30.049141 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-44d58684-616a-4b0d-a625-1c4f548a2d8c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:30.049663 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-44d58684-616a-4b0d-a625-1c4f548a2d8c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:30.056492 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-44d58684-616a-4b0d-a625-1c4f548a2d8c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:30.056492 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-44d58684-616a-4b0d-a625-1c4f548a2d8c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:30.185452 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-44d58684-616a-4b0d-a625-1c4f548a2d8c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:30.193738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-44d58684-616a-4b0d-a625-1c4f548a2d8c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1367 microversion: 2.1 time: 0.156971 Jul 15 16:01:30.197599 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 480/966] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:30 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:01:30.585502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:30.586445 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:30.593128 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:30.594834 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:30.595803 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:30.596158 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:31.016385 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:31.025055 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:31.026847 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:31.028413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-377dab5d-21ba-4fec-b62f-bdbbe74ead9b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.446710 Jul 15 16:01:31.028993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 487/967] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:30 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:31.212394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b07fbe6c-5ae3-4bf5-b76e-a76e5a459baf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:31.213023 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b07fbe6c-5ae3-4bf5-b76e-a76e5a459baf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:31.219710 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b07fbe6c-5ae3-4bf5-b76e-a76e5a459baf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:31.220168 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b07fbe6c-5ae3-4bf5-b76e-a76e5a459baf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:31.223584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b07fbe6c-5ae3-4bf5-b76e-a76e5a459baf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:31.223584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b07fbe6c-5ae3-4bf5-b76e-a76e5a459baf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:31.367551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b07fbe6c-5ae3-4bf5-b76e-a76e5a459baf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:31.375972 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b07fbe6c-5ae3-4bf5-b76e-a76e5a459baf tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1554 microversion: 2.1 time: 0.167140 Jul 15 16:01:31.376558 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 481/968] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:01:31 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:01:31.392389 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8ce3660c-9aac-4230-b497-fede766e101c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:31.392884 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8ce3660c-9aac-4230-b497-fede766e101c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:31.398922 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8ce3660c-9aac-4230-b497-fede766e101c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:31.399417 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8ce3660c-9aac-4230-b497-fede766e101c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:31.400189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8ce3660c-9aac-4230-b497-fede766e101c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:31.400627 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8ce3660c-9aac-4230-b497-fede766e101c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:31.479756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8ce3660c-9aac-4230-b497-fede766e101c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091048 Jul 15 16:01:31.480353 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 488/969] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Jul 15 16:01:31 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:32.047626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:32.048767 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:32.055555 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:32.056047 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:32.056865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:32.057281 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:32.192995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:32.203571 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:32.205080 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:32.206263 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f8d73202-aa3f-4eaf-a466-195e91348dc5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.163353 Jul 15 16:01:32.206837 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 482/970] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:32 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:32.522758 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-ee6688de-ffda-41e9-ac16-453f27861ca6 req-4cff44b6-99a9-4b5e-a13b-115b19b269b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd957115-e1c8-4716-82fa-73ca85975a93", "tag": "9bd50bc2-c176-4cb7-a0a2-6b8557815227"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:32.531410 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-ee6688de-ffda-41e9-ac16-453f27861ca6 req-4cff44b6-99a9-4b5e-a13b-115b19b269b6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:32.531864 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-ee6688de-ffda-41e9-ac16-453f27861ca6 req-4cff44b6-99a9-4b5e-a13b-115b19b269b6 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:32.544748 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-ee6688de-ffda-41e9-ac16-453f27861ca6 req-4cff44b6-99a9-4b5e-a13b-115b19b269b6 service nova] Creating event network-changed:9bd50bc2-c176-4cb7-a0a2-6b8557815227 for instance bd957115-e1c8-4716-82fa-73ca85975a93 on hv-cinder-83587 Jul 15 16:01:32.550269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-ee6688de-ffda-41e9-ac16-453f27861ca6 req-4cff44b6-99a9-4b5e-a13b-115b19b269b6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031590 Jul 15 16:01:32.550918 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 489/971] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:33.224768 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:33.225534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:33.231962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:33.232418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:33.233186 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:33.233624 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:33.375000 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:33.384159 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:33.385833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:33.387188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fd46abb0-4aa6-4775-9378-394437295e81 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.166326 Jul 15 16:01:33.387790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 483/972] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:33 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:34.406858 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:34.407591 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:34.414706 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:34.415190 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:34.416071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:34.416577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:34.546284 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:34.554766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:34.556287 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:34.557428 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b5d1e7f7-c63a-4d80-81cb-ead3f740a0f8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.155161 Jul 15 16:01:34.557988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 490/973] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:34 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:35.576039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:35.576661 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:35.583716 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:35.584169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:35.585581 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:35.586297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:35.720322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:35.728785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:35.730283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:35.731508 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5f897a71-42da-4b55-9779-ac2bf55a3fe3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.159572 Jul 15 16:01:35.732065 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 484/974] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:35 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:36.749812 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:36.750988 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:36.757956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:36.758411 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:36.759183 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:36.759738 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:36.896907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:36.908870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:36.911017 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:36.912262 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-150c9e34-2cc7-479a-a415-6fe5bbad98c9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1742 microversion: 2.20 time: 0.166577 Jul 15 16:01:36.912864 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 491/975] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:36 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:37.929750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:37.930291 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:37.936982 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:37.937985 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:37.938749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:37.939187 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:38.079860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:38.088258 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:38.089760 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:38.090946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7f4ae760-7da8-42e1-b260-950f563058ed tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1742 microversion: 2.20 time: 0.165220 Jul 15 16:01:38.091550 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 485/976] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:37 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:39.109454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:39.109975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:39.116790 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:39.117241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:39.118011 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:39.118449 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:39.245311 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:39.253858 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:39.255378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:39.256523 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-793e7e73-ea78-4cc8-88ba-45902cf6e6b4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1742 microversion: 2.20 time: 0.151054 Jul 15 16:01:39.257110 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 492/977] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:39 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:40.275285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:40.275940 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:40.283250 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:40.283732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:40.284516 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:40.284958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:40.373383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-bd4dc7cb-feb3-4568-a140-92b43bdec488 req-b6e7a409-d922-475a-a7ba-efe37e4bea71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6551bf2-1fcd-4a78-8a1a-2965321d67cb", "name": "network-vif-plugged", "status": "completed", "tag": "83f76815-bc46-4425-9b12-ba30c2ba8bd0"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:01:40.382808 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-bd4dc7cb-feb3-4568-a140-92b43bdec488 req-b6e7a409-d922-475a-a7ba-efe37e4bea71 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:40.383497 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-bd4dc7cb-feb3-4568-a140-92b43bdec488 req-b6e7a409-d922-475a-a7ba-efe37e4bea71 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:40.395748 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-bd4dc7cb-feb3-4568-a140-92b43bdec488 req-b6e7a409-d922-475a-a7ba-efe37e4bea71 service nova] Creating event network-vif-plugged:83f76815-bc46-4425-9b12-ba30c2ba8bd0 for instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb on hv-cinder-83587 Jul 15 16:01:40.400690 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-bd4dc7cb-feb3-4568-a140-92b43bdec488 req-b6e7a409-d922-475a-a7ba-efe37e4bea71 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031261 Jul 15 16:01:40.401433 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 493/978] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:01:40.420500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:40.428408 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:40.429889 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:40.431044 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d407747f-d443-490e-b2bb-24488787f75b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1742 microversion: 2.20 time: 0.159679 Jul 15 16:01:40.431622 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 486/979] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:40 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:41.449333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:41.450021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:41.457271 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:41.457719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:41.458505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:41.458944 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:41.585727 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:41.593862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:41.595394 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:41.596555 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8d51d16d-f0d5-4dd3-b7bf-af832d918047 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1742 microversion: 2.20 time: 0.151448 Jul 15 16:01:41.597115 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 494/980] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:41 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:42.614686 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:42.615324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:42.621897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:42.622354 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:42.623133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:42.623598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:42.750698 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:42.759079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:42.760794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:42.761802 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fc1a9c7c-9666-4770-ad24-c2c4d762093d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1742 microversion: 2.20 time: 0.151101 Jul 15 16:01:42.762362 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 487/981] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:42 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:43.780427 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:43.781566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:43.788102 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:43.788558 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:43.789337 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:43.789775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:43.921187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:43.929709 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:43.931186 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:43.932352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-79cf5ce4-6665-406f-b5b8-4ff079fcdc04 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1742 microversion: 2.20 time: 0.155828 Jul 15 16:01:43.932906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 495/982] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:43 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:44.949841 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:44.950467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:44.957185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:44.957634 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:44.958404 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:44.958835 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:45.116077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:45.126217 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:45.129319 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:45.130531 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d9701453-5404-4c34-907c-bb44f64e66a7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.184585 Jul 15 16:01:45.131096 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 488/983] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:44 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:46.149632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:46.150248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:46.156855 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:46.157394 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:46.158090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:46.158563 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:46.292633 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:46.301045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:46.302538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:46.303764 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5daea9b7-eba1-48a3-b95b-db4da580a87f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.157974 Jul 15 16:01:46.304659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 496/984] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:46 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:47.322533 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:47.323141 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:47.325501 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:47.331007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:47.331521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:47.336387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:47.336387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:47.500389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:47.502884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=100 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:47.509542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:47.511037 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:47.513697 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1d8a5092-5558-4b09-9f2e-88c3051bf208 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.193759 Jul 15 16:01:47.513697 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 489/985] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:47 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:48.530030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:48.531151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:48.537663 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:48.538115 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:48.539074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:48.539552 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:48.680292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:48.689107 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:48.690622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:48.692040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-915adc07-f627-4452-a10f-23860a92d5d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.166001 Jul 15 16:01:48.692768 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 497/986] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:48 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:49.711349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:49.712220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:49.719978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:49.720431 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:49.721217 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:49.721653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:49.871626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:49.882449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:49.884500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:49.886339 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9b075e70-551a-4f62-88c4-90581daee73c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.179188 Jul 15 16:01:49.889614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 490/987] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:49 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:50.907700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:50.909069 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:50.911613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=48 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:50.916490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:50.916949 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:50.917749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:50.918172 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:50.936490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=100 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:01:51.059243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:51.069048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:51.070899 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:51.072529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2f26c6cb-dcb8-40b6-9df1-6fac72fcaa30 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.168911 Jul 15 16:01:51.073648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 498/988] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:50 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:52.095779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:52.096534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:52.103250 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:52.103900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:52.104685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:52.105128 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:52.250886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:52.259923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:52.261426 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:52.262604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d55cd64c-c8da-4ea0-9116-c6e3122185a4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.170744 Jul 15 16:01:52.263163 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 491/989] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:52 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:53.282258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:53.282865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:53.291006 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:53.291496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:53.292273 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:53.292712 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:53.441131 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:53.449597 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:53.451103 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:53.452284 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-68d5ef85-bd42-4b3a-8899-3d8a293e805b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.175067 Jul 15 16:01:53.453616 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 499/990] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:53 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:54.472044 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:54.473135 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:54.480984 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:54.486754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:54.486754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:54.486754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:54.629987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:54.639345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:54.641545 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:54.642798 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6b08693a-fc3d-439f-ab86-9fd2b9ea7482 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.175773 Jul 15 16:01:54.647042 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 492/991] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:54 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:55.661898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:55.662442 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:55.669500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:55.670304 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:55.672024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:55.672690 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:55.825842 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:55.835575 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:55.837298 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:55.838452 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-daec351d-15e1-4c5e-b8c5-fcb9381274e4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.180773 Jul 15 16:01:55.839137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 500/992] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:55 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:56.857484 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:56.858034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:56.865575 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:56.866076 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:56.866933 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:56.867398 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:57.014426 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:57.023393 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:57.024905 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:57.026174 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ee339f8d-3bc2-4963-85bf-ba2e51487c69 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.172729 Jul 15 16:01:57.026744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 493/993] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:56 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:58.044353 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:58.044984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:58.051222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:58.051722 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:58.052500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:58.052947 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:58.184388 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:58.192875 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:58.194369 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:58.195542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d1b964b3-4b53-42d1-8949-36da240e3720 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.155200 Jul 15 16:01:58.196093 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 501/994] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:58 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:01:59.214838 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:01:59.218137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:01:59.235569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:59.236344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:59.238460 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:01:59.239624 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:01:59.410150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:59.418987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:59.420746 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:01:59.422465 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b315b663-0c53-4a4a-aaff-a27652961a09 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.212384 Jul 15 16:01:59.423745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 494/995] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:01:59 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:00.440285 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:00.440898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:00.447612 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:00.448066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:00.448832 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:00.449268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:00.581819 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:00.590145 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:00.591758 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:00.592908 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-64291233-cfcc-4942-bba8-810b57e44826 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1737 microversion: 2.20 time: 0.157324 Jul 15 16:02:00.593467 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 502/996] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:00 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:01.615746 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:01.616518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:01.623413 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:01.623911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:01.625318 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:01.625752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:01.757150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:01.765178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:01.766668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:01.767854 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-735571dd-75eb-4e76-a3e6-3778e862ef67 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1719 microversion: 2.20 time: 0.156062 Jul 15 16:02:01.768415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 495/997] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:01 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:02.787808 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:02.789437 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:02.797109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:02.797752 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:02.798734 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:02.799184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:02.957498 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:02.965589 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:02.967096 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:02.968307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-67148a30-a3be-43db-a825-72ead8bfb71a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1719 microversion: 2.20 time: 0.186274 Jul 15 16:02:02.968876 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 503/998] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:02 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:03.988232 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:03.989202 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:03.996115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:03.996613 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:03.997402 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:03.997846 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:04.134115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:04.142049 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:04.143625 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:04.144788 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-087a6a80-dbcb-4513-b168-8aec10fac9e8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1722 microversion: 2.20 time: 0.162931 Jul 15 16:02:04.145341 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 496/999] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:03 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 16:02:04.162734 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fbe5d918-46db-4440-ac82-257921170437 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecf71bc9-1e2d-4a70-af64-fbd26409de35"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:02:04.163887 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fbe5d918-46db-4440-ac82-257921170437 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:04.170475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fbe5d918-46db-4440-ac82-257921170437 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:04.170989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fbe5d918-46db-4440-ac82-257921170437 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:04.172436 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fbe5d918-46db-4440-ac82-257921170437 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:04.172873 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fbe5d918-46db-4440-ac82-257921170437 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:04.495720 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-d389513d-66ac-4bee-828f-d9a071b583a8 req-72cd085a-45c9-49dc-bd6a-59939abc54cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6551bf2-1fcd-4a78-8a1a-2965321d67cb", "name": "network-vif-unplugged", "status": "completed", "tag": "83f76815-bc46-4425-9b12-ba30c2ba8bd0"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:02:04.504133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-d389513d-66ac-4bee-828f-d9a071b583a8 req-72cd085a-45c9-49dc-bd6a-59939abc54cd service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:04.504582 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-d389513d-66ac-4bee-828f-d9a071b583a8 req-72cd085a-45c9-49dc-bd6a-59939abc54cd service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:04.516319 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-d389513d-66ac-4bee-828f-d9a071b583a8 req-72cd085a-45c9-49dc-bd6a-59939abc54cd service nova] Creating event network-vif-unplugged:83f76815-bc46-4425-9b12-ba30c2ba8bd0 for instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb on hv-cinder-83587 Jul 15 16:02:04.521279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-d389513d-66ac-4bee-828f-d9a071b583a8 req-72cd085a-45c9-49dc-bd6a-59939abc54cd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029263 Jul 15 16:02:04.521956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 497/1000] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:02:05.385640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fbe5d918-46db-4440-ac82-257921170437 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.226855 Jul 15 16:02:05.386365 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 504/1001] 10.222.0.98 () {62 vars in 1363 bytes} [Fri Jul 15 16:02:04 2022] POST /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/os-volume_attachments => generated 188 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 16:02:05.500005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ea0874a4-a43c-4099-8da0-5f11ec647ad2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:05.500607 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ea0874a4-a43c-4099-8da0-5f11ec647ad2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:05.507315 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ea0874a4-a43c-4099-8da0-5f11ec647ad2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:05.507772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ea0874a4-a43c-4099-8da0-5f11ec647ad2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:05.508544 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ea0874a4-a43c-4099-8da0-5f11ec647ad2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:05.508989 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ea0874a4-a43c-4099-8da0-5f11ec647ad2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:08.653278 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ea0874a4-a43c-4099-8da0-5f11ec647ad2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/os-volume_attachments/ecf71bc9-1e2d-4a70-af64-fbd26409de35" status: 202 len: 0 microversion: 2.20 time: 3.158172 Jul 15 16:02:08.653948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 498/1002] 10.222.0.98 () {60 vars in 1456 bytes} [Fri Jul 15 16:02:05 2022] DELETE /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/os-volume_attachments/ecf71bc9-1e2d-4a70-af64-fbd26409de35 => generated 0 bytes in 3160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:02:08.710929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6fb74416-94b5-40e8-a60c-06cb54ad4aa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:02:08.711796 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6fb74416-94b5-40e8-a60c-06cb54ad4aa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:08.718408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6fb74416-94b5-40e8-a60c-06cb54ad4aa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:08.718863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6fb74416-94b5-40e8-a60c-06cb54ad4aa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:08.719661 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6fb74416-94b5-40e8-a60c-06cb54ad4aa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:08.720103 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6fb74416-94b5-40e8-a60c-06cb54ad4aa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:08.930729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6fb74416-94b5-40e8-a60c-06cb54ad4aa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "POST /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/action" status: 202 len: 0 microversion: 2.20 time: 0.224071 Jul 15 16:02:08.931466 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 505/1003] 10.222.0.98 () {62 vars in 1318 bytes} [Fri Jul 15 16:02:08 2022] POST /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:02:08.939640 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:08.944548 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:08.947118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:08.947638 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:08.948400 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:08.948843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:09.085880 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:09.094187 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:09.095699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:09.096870 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a7b15ca6-b992-4831-a40a-3804844358d7 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1670 microversion: 2.20 time: 0.161259 Jul 15 16:02:09.097434 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 499/1004] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:08 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:10.116715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:10.117329 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:10.123754 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:10.124208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:10.125042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:10.125504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:10.254298 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:10.264098 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:10.266240 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:10.267438 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-881009f2-a956-46d9-b484-029af5620ae3 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1670 microversion: 2.20 time: 0.155124 Jul 15 16:02:10.267986 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 506/1005] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:10 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 16:02:11.286639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:11.287263 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:11.293963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:11.294421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:11.295209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:11.295844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:11.442936 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:11.450993 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:11.452530 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:11.453718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bdff698c-d6e4-4ef1-836c-9f6f474f071f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.171518 Jul 15 16:02:11.454283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 500/1006] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:11 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:12.471825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:12.472443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:12.479594 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:12.480052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:12.480824 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:12.481268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:12.627041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:12.629233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:12.630767 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:12.632002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2ea48aeb-4bc6-47e5-949a-4b7252a039c1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.164033 Jul 15 16:02:12.632557 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 507/1007] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:12 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:13.652797 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:13.654048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:13.664943 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:13.665396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:13.666189 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:13.666625 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:13.857537 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:13.866178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:13.867693 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:13.868846 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2cbd6b7f-d140-4dc0-8215-87468bd315fd tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.220202 Jul 15 16:02:13.869435 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 501/1008] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:13 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:14.885886 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:14.886494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:14.893343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:14.893853 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:14.894630 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:14.895060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:15.210724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:15.221360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:15.223121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:15.224384 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a4c91202-69f5-4597-a1b6-13d482d40b43 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.342368 Jul 15 16:02:15.225124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 508/1009] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:14 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:16.242099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:16.242758 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:16.249471 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:16.249938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:16.250694 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:16.251130 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:16.439084 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:16.447860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:16.449442 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:16.450875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-48e65894-7c19-4f68-bf2b-05f317d64ee8 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.212806 Jul 15 16:02:16.451554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 502/1010] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:16 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:17.469761 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:17.470366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:17.476786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:17.477238 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:17.478000 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:17.478434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:17.640075 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:17.648681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:17.650169 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:17.652201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ad5e0a35-e6b5-47f4-b497-e55958c89b11 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.185363 Jul 15 16:02:17.652201 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 509/1011] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:17 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:18.671058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:18.671693 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:18.673865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=28 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:02:18.678697 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:18.679154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:18.679983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:18.680425 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:18.812973 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:18.822099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:18.823907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:18.825456 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e442fe71-27ae-4bba-b316-9cda67d99f39 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.158372 Jul 15 16:02:18.826102 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 503/1012] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:18 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:19.845726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:19.846478 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:19.853700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:19.854186 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:19.855198 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:19.856071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:20.003279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:20.012359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:20.013900 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:20.015062 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-614f6040-d643-4f3b-8ae8-fb6d18d1523f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.173707 Jul 15 16:02:20.015648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 510/1013] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:19 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:21.033660 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:21.034297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:21.041592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:21.042051 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:21.042826 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:21.043266 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:21.045937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:02:21.180294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:21.188282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:21.190099 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:21.191680 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-40c88beb-9d9e-4966-a17c-6cd04a97eb8f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.161548 Jul 15 16:02:21.195444 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 504/1014] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:21 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 16:02:22.216159 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:22.216756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:22.218623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=28 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:02:22.224544 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:22.225015 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:22.225845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:22.226292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:22.229312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:02:22.375385 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:22.384379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:22.385897 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:22.387260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ec983e65-6e97-46f5-85e9-867294a62cbf tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.177306 Jul 15 16:02:22.387908 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 511/1015] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:22 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 16:02:23.406406 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:23.407088 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:23.413962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:23.414419 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:23.415195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:23.415672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:23.560483 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:23.569035 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:23.570512 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:23.571702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fbbbf8dc-06e8-475a-8aa4-034ff445065a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.169673 Jul 15 16:02:23.572259 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 505/1016] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:23 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:24.590913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:24.591581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:24.599452 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:24.599872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:24.600674 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:24.601121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:24.738623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:24.746661 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:24.748212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:24.749414 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9ddfa593-c3af-4322-80f0-b2de7d60dbbc tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.162647 Jul 15 16:02:24.749966 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 512/1017] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:24 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:25.767024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:25.806692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:25.806692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:25.806692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:25.806692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:25.807221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:25.914000 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:25.922091 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:25.923626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:25.924794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c89966da-24ba-4fa5-af86-60bd90f3acd9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.161802 Jul 15 16:02:25.925368 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 506/1018] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:25 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:26.946370 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:26.947327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:26.956585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:26.957039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:26.957823 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:26.958749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:27.089553 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:27.097410 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:27.098887 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:27.100067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f5082119-d09e-45c3-9357-385cd7abc5f5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.158115 Jul 15 16:02:27.100614 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 513/1019] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:26 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:28.118113 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:28.118756 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:28.125348 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:28.125793 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:28.126553 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:28.126990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:28.266288 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:28.274389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:28.275940 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:28.277151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1463a38e-ff5a-4b82-9267-36c273ffe4d1 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.162972 Jul 15 16:02:28.277723 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 507/1020] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:28 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:29.296772 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:29.297374 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:29.303892 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:29.304350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:29.305127 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:29.305568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:29.435767 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:29.444303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:29.445811 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:29.446946 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9d8d2646-9737-40dd-982a-435090f7ea12 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.154179 Jul 15 16:02:29.447513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 514/1021] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:29 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:30.466475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:30.467088 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:30.474387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:30.475060 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:30.476032 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:30.476469 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:30.608819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:30.616824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:30.618344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:30.619550 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6077618a-809e-46de-ad11-005fa17e0604 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.157947 Jul 15 16:02:30.620174 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 508/1022] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:30 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:31.640027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:31.640552 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:31.652975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:31.653421 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:31.654192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:31.654624 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:31.785286 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:31.793570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:31.795038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:31.796208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-eaa1a27a-dfe7-4ddf-b354-e827fc4b125f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.162223 Jul 15 16:02:31.796766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 515/1023] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:31 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:32.696738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-1501e938-d71a-40f2-8edb-c6bdd3eaca16 req-db130b94-1860-4d17-9d0c-0537bbe69896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6551bf2-1fcd-4a78-8a1a-2965321d67cb", "name": "network-vif-plugged", "status": "completed", "tag": "83f76815-bc46-4425-9b12-ba30c2ba8bd0"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:02:32.705555 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-1501e938-d71a-40f2-8edb-c6bdd3eaca16 req-db130b94-1860-4d17-9d0c-0537bbe69896 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:32.706008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-1501e938-d71a-40f2-8edb-c6bdd3eaca16 req-db130b94-1860-4d17-9d0c-0537bbe69896 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:32.723141 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-1501e938-d71a-40f2-8edb-c6bdd3eaca16 req-db130b94-1860-4d17-9d0c-0537bbe69896 service nova] Creating event network-vif-plugged:83f76815-bc46-4425-9b12-ba30c2ba8bd0 for instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb on hv-cinder-83587 Jul 15 16:02:32.730985 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-1501e938-d71a-40f2-8edb-c6bdd3eaca16 req-db130b94-1860-4d17-9d0c-0537bbe69896 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037630 Jul 15 16:02:32.731882 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 509/1024] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:02:32.814359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:32.814973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:32.821752 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:32.823825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:32.823825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:32.823825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:32.953994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:32.963893 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:32.965651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:32.967016 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ef38f5e8-5a40-49b0-95fe-05d89a054e0c tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.156650 Jul 15 16:02:32.967625 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 516/1025] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:32 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:33.986748 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:33.987485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:33.994334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:33.994790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:33.995591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:33.996045 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:34.125351 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:34.133324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:34.134830 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:34.136027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e43cfcaf-8fc6-4ca4-8e4c-48ab2977316a tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.154029 Jul 15 16:02:34.136593 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 510/1026] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:33 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:35.153559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:35.154165 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:35.162881 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:35.164151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:35.165329 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:35.165990 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:35.309434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:35.317761 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:35.319252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:35.320920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-84ea5790-9e46-4866-9f16-fd3a715ed00d tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.171269 Jul 15 16:02:35.321468 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 517/1027] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:35 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:36.339606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:36.340225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:36.346844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:36.347314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:36.348176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:36.348615 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:36.479650 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:36.487569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:36.489065 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:36.490229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-211cc80e-5b6a-46ad-b124-86e304fa3fb4 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1728 microversion: 2.20 time: 0.155384 Jul 15 16:02:36.490794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 511/1028] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:36 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:37.509185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:37.509797 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:37.516293 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:37.516742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:37.517508 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:37.517947 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:37.650911 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:37.658872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:37.660402 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:02:37.661545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d8604815-321c-42f2-8033-a802d68d3725 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1715 microversion: 2.20 time: 0.156267 Jul 15 16:02:37.662100 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 518/1029] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:02:37 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:02:38.050266 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-df1177ff-96f2-4976-bb63-9eb70ab181af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:38.050819 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-df1177ff-96f2-4976-bb63-9eb70ab181af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:38.058109 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df1177ff-96f2-4976-bb63-9eb70ab181af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:38.058569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df1177ff-96f2-4976-bb63-9eb70ab181af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:38.059378 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df1177ff-96f2-4976-bb63-9eb70ab181af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:38.059821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df1177ff-96f2-4976-bb63-9eb70ab181af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:38.082611 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-df1177ff-96f2-4976-bb63-9eb70ab181af tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/ips" status: 200 len: 145 microversion: 2.1 time: 0.036211 Jul 15 16:02:38.083173 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 512/1030] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 16:02:38 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:02:40.767351 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7e1b24e2-2643-4e1f-904f-973a047409d1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "582a349d-ece6-4de0-a209-a44152f8d955"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:02:40.768521 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7e1b24e2-2643-4e1f-904f-973a047409d1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:40.775916 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7e1b24e2-2643-4e1f-904f-973a047409d1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:40.776302 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7e1b24e2-2643-4e1f-904f-973a047409d1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:40.777064 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7e1b24e2-2643-4e1f-904f-973a047409d1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:40.777499 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7e1b24e2-2643-4e1f-904f-973a047409d1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:41.704091 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7e1b24e2-2643-4e1f-904f-973a047409d1 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940373 Jul 15 16:02:41.704606 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 519/1031] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 16:02:40 2022] POST /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:02:52.368384 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bb09bfc9-3226-4577-8786-cc0f603796e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:52.369323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bb09bfc9-3226-4577-8786-cc0f603796e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:52.371713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=19 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:02:52.372400 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=47 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:02:52.377168 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb09bfc9-3226-4577-8786-cc0f603796e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:52.377626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb09bfc9-3226-4577-8786-cc0f603796e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:52.378399 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb09bfc9-3226-4577-8786-cc0f603796e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:52.378844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bb09bfc9-3226-4577-8786-cc0f603796e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:52.410217 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bb09bfc9-3226-4577-8786-cc0f603796e2 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045769 Jul 15 16:02:52.410792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 513/1032] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:02:52 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:02:52.419321 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=17 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:02:52.420105 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:02:52.424171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9e3972c8-3be9-4127-892c-116606ceead3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:02:52.424817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9e3972c8-3be9-4127-892c-116606ceead3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:52.430789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e3972c8-3be9-4127-892c-116606ceead3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:52.431229 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e3972c8-3be9-4127-892c-116606ceead3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:52.432021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e3972c8-3be9-4127-892c-116606ceead3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:52.432453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9e3972c8-3be9-4127-892c-116606ceead3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:52.466567 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9e3972c8-3be9-4127-892c-116606ceead3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/582a349d-ece6-4de0-a209-a44152f8d955" status: 200 len: 194 microversion: 2.1 time: 0.048756 Jul 15 16:02:52.467175 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 520/1033] 10.222.0.98 () {58 vars in 1412 bytes} [Fri Jul 15 16:02:52 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/582a349d-ece6-4de0-a209-a44152f8d955 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:02:55.162330 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2d3bba89-f536-4411-b185-2a2719c61db7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "240dacad-35f1-44fc-8654-5725b50c8dad"}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:02:55.163443 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2d3bba89-f536-4411-b185-2a2719c61db7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:02:55.170953 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d3bba89-f536-4411-b185-2a2719c61db7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:55.171437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d3bba89-f536-4411-b185-2a2719c61db7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:55.172224 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d3bba89-f536-4411-b185-2a2719c61db7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:02:55.172674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d3bba89-f536-4411-b185-2a2719c61db7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:02:56.075813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2d3bba89-f536-4411-b185-2a2719c61db7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "POST /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916937 Jul 15 16:02:56.076343 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 514/1034] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 16:02:55 2022] POST /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:02.525127 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-94874120", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "networks": [{"uuid": "83d2fdc3-c6fb-4201-b803-31249831a8e8"}]}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:02.583288 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] validate_networks() for [('83d2fdc3-c6fb-4201-b803-31249831a8e8', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:03:03.021407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:03:03.027021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:03:03.027021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:03:03.027021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:03:03.027021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:03:03.032492 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:03.032929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:03.033722 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:03.034159 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:03.055380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Getting quotas for project 836bc4ea37f841cf9704999d88a627c4. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:03:03.059264 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Getting quotas for user cd49fd5c3cd5463b88efa5937d88cea0 and project 836bc4ea37f841cf9704999d88a627c4. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:03:03.070124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:03:03.073059 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:03:03.192838 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b8ed61bc-edd1-4629-b828-b2a928f9e4cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672102 Jul 15 16:03:03.193527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 521/1035] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:03:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 16:03:03.204873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4306b4bf-8434-4c2c-b7e4-b2f79c17c610 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:03.205628 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4306b4bf-8434-4c2c-b7e4-b2f79c17c610 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:03.261950 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4306b4bf-8434-4c2c-b7e4-b2f79c17c610 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:03.269397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4306b4bf-8434-4c2c-b7e4-b2f79c17c610 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1217 microversion: 2.1 time: 0.069440 Jul 15 16:03:03.269961 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 515/1036] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:03 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:04.286569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-874b62a4-af24-42e7-8dea-6266eb7897fe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:04.287108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-874b62a4-af24-42e7-8dea-6266eb7897fe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:04.342009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-874b62a4-af24-42e7-8dea-6266eb7897fe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:04.352407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-874b62a4-af24-42e7-8dea-6266eb7897fe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1217 microversion: 2.1 time: 0.070231 Jul 15 16:03:04.353073 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 522/1037] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:04 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:05.369732 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a88d7db3-a81f-4437-a691-b7df6787a40c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:05.370355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a88d7db3-a81f-4437-a691-b7df6787a40c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:05.377200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a88d7db3-a81f-4437-a691-b7df6787a40c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:05.377656 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a88d7db3-a81f-4437-a691-b7df6787a40c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:05.378451 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a88d7db3-a81f-4437-a691-b7df6787a40c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:05.378873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a88d7db3-a81f-4437-a691-b7df6787a40c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:05.440662 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a88d7db3-a81f-4437-a691-b7df6787a40c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:05.448562 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a88d7db3-a81f-4437-a691-b7df6787a40c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1221 microversion: 2.1 time: 0.082906 Jul 15 16:03:05.449135 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 516/1038] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:05 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:06.465227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2d447bc4-2c52-408c-bcb2-e47be040e502 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:06.465840 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2d447bc4-2c52-408c-bcb2-e47be040e502 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:06.472343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2d447bc4-2c52-408c-bcb2-e47be040e502 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:06.472798 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2d447bc4-2c52-408c-bcb2-e47be040e502 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:06.473570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2d447bc4-2c52-408c-bcb2-e47be040e502 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:06.474006 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2d447bc4-2c52-408c-bcb2-e47be040e502 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:06.533546 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2d447bc4-2c52-408c-bcb2-e47be040e502 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:06.541475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2d447bc4-2c52-408c-bcb2-e47be040e502 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1221 microversion: 2.1 time: 0.080843 Jul 15 16:03:06.546432 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 523/1039] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:06 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:07.558890 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-50755b02-8449-4705-81f4-2e2467ef9c0b tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:07.559556 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-50755b02-8449-4705-81f4-2e2467ef9c0b tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:07.566067 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-50755b02-8449-4705-81f4-2e2467ef9c0b tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:07.566514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-50755b02-8449-4705-81f4-2e2467ef9c0b tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:07.567285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-50755b02-8449-4705-81f4-2e2467ef9c0b tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:07.567752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-50755b02-8449-4705-81f4-2e2467ef9c0b tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:07.631157 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-50755b02-8449-4705-81f4-2e2467ef9c0b tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:07.638580 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-50755b02-8449-4705-81f4-2e2467ef9c0b tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1221 microversion: 2.1 time: 0.084222 Jul 15 16:03:07.639146 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 517/1040] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:07 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:08.655211 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-61c1faf0-d409-436a-9cbf-4f3184ddb323 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:08.660131 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-61c1faf0-d409-436a-9cbf-4f3184ddb323 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:08.662268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-61c1faf0-d409-436a-9cbf-4f3184ddb323 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:08.662725 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-61c1faf0-d409-436a-9cbf-4f3184ddb323 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:08.663547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-61c1faf0-d409-436a-9cbf-4f3184ddb323 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:08.663989 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-61c1faf0-d409-436a-9cbf-4f3184ddb323 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:08.728460 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-61c1faf0-d409-436a-9cbf-4f3184ddb323 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:08.736141 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-61c1faf0-d409-436a-9cbf-4f3184ddb323 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1269 microversion: 2.1 time: 0.084835 Jul 15 16:03:08.736707 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 524/1041] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:08 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:08.837334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-35307306-0dbb-414e-ac0e-0dd3d5cc3126 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:08.838738 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-35307306-0dbb-414e-ac0e-0dd3d5cc3126 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:08.845299 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-35307306-0dbb-414e-ac0e-0dd3d5cc3126 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:08.845749 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-35307306-0dbb-414e-ac0e-0dd3d5cc3126 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:08.846527 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-35307306-0dbb-414e-ac0e-0dd3d5cc3126 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:08.846953 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-35307306-0dbb-414e-ac0e-0dd3d5cc3126 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:08.876141 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-35307306-0dbb-414e-ac0e-0dd3d5cc3126 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043350 Jul 15 16:03:08.876694 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 518/1042] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:03:08 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:09.019904 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-89ff77ff-5bc8-48a4-8b53-98ea82a41cca tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:09.020416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-89ff77ff-5bc8-48a4-8b53-98ea82a41cca tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:09.026469 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-89ff77ff-5bc8-48a4-8b53-98ea82a41cca tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:09.026919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-89ff77ff-5bc8-48a4-8b53-98ea82a41cca tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:09.027715 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-89ff77ff-5bc8-48a4-8b53-98ea82a41cca tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:09.028149 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-89ff77ff-5bc8-48a4-8b53-98ea82a41cca tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:09.059420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-89ff77ff-5bc8-48a4-8b53-98ea82a41cca tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/582a349d-ece6-4de0-a209-a44152f8d955" status: 200 len: 194 microversion: 2.1 time: 0.043420 Jul 15 16:03:09.060025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 525/1043] 10.222.0.98 () {58 vars in 1412 bytes} [Fri Jul 15 16:03:09 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/582a349d-ece6-4de0-a209-a44152f8d955 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:09.069595 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a216a6f6-d7a6-4675-a4b2-92239f6f8b9f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:09.070133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a216a6f6-d7a6-4675-a4b2-92239f6f8b9f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:09.076118 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a216a6f6-d7a6-4675-a4b2-92239f6f8b9f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:09.076572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a216a6f6-d7a6-4675-a4b2-92239f6f8b9f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:09.077336 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a216a6f6-d7a6-4675-a4b2-92239f6f8b9f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:09.077776 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a216a6f6-d7a6-4675-a4b2-92239f6f8b9f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:09.158500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-a216a6f6-d7a6-4675-a4b2-92239f6f8b9f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lazy-loading 'services' on Instance uuid 548a2776-957b-44bc-86c1-914102f3da94 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:03:09.368460 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a216a6f6-d7a6-4675-a4b2-92239f6f8b9f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/582a349d-ece6-4de0-a209-a44152f8d955" status: 202 len: 0 microversion: 2.1 time: 0.301900 Jul 15 16:03:09.369272 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 519/1044] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:03:09 2022] DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/582a349d-ece6-4de0-a209-a44152f8d955 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:03:09.753406 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-843592fe-cd95-46b5-a419-aa9dbda463d3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:09.754021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-843592fe-cd95-46b5-a419-aa9dbda463d3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:09.760427 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-843592fe-cd95-46b5-a419-aa9dbda463d3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:09.760883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-843592fe-cd95-46b5-a419-aa9dbda463d3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:09.761655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-843592fe-cd95-46b5-a419-aa9dbda463d3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:09.762091 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-843592fe-cd95-46b5-a419-aa9dbda463d3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:09.844241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-843592fe-cd95-46b5-a419-aa9dbda463d3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:09.852583 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-843592fe-cd95-46b5-a419-aa9dbda463d3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1275 microversion: 2.1 time: 0.102992 Jul 15 16:03:09.853151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 526/1045] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:09 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:10.870987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9d1f7c05-9d04-431d-a374-afcfd3705dc3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:10.871806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9d1f7c05-9d04-431d-a374-afcfd3705dc3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:10.878108 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9d1f7c05-9d04-431d-a374-afcfd3705dc3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:10.884015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9d1f7c05-9d04-431d-a374-afcfd3705dc3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:10.884015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9d1f7c05-9d04-431d-a374-afcfd3705dc3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:10.884015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9d1f7c05-9d04-431d-a374-afcfd3705dc3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:11.014479 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9d1f7c05-9d04-431d-a374-afcfd3705dc3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:11.022270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9d1f7c05-9d04-431d-a374-afcfd3705dc3 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.156444 Jul 15 16:03:11.022849 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 520/1046] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:10 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:11.164343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-b89cc058-770d-417e-aadf-b6d32be01810 req-71ea70c1-72b6-4567-a9ad-d21c78b55efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65288e88-4533-4139-9d66-f83c022d57db", "tag": "e1246a30-532b-4be5-9b1f-e60c689fa115"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:11.173826 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-b89cc058-770d-417e-aadf-b6d32be01810 req-71ea70c1-72b6-4567-a9ad-d21c78b55efc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:11.174361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-b89cc058-770d-417e-aadf-b6d32be01810 req-71ea70c1-72b6-4567-a9ad-d21c78b55efc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:11.186777 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-b89cc058-770d-417e-aadf-b6d32be01810 req-71ea70c1-72b6-4567-a9ad-d21c78b55efc service nova] Creating event network-changed:e1246a30-532b-4be5-9b1f-e60c689fa115 for instance 65288e88-4533-4139-9d66-f83c022d57db on hv-cinder-83587 Jul 15 16:03:11.191498 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-b89cc058-770d-417e-aadf-b6d32be01810 req-71ea70c1-72b6-4567-a9ad-d21c78b55efc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030900 Jul 15 16:03:11.192108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 527/1047] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:11.535254 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-85d5aeb9-3ae7-4820-8aec-c8f1818fdc45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:11.535764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-85d5aeb9-3ae7-4820-8aec-c8f1818fdc45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:11.542221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-85d5aeb9-3ae7-4820-8aec-c8f1818fdc45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:11.542610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-85d5aeb9-3ae7-4820-8aec-c8f1818fdc45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:11.543459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-85d5aeb9-3ae7-4820-8aec-c8f1818fdc45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:11.543896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-85d5aeb9-3ae7-4820-8aec-c8f1818fdc45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:11.582731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-85d5aeb9-3ae7-4820-8aec-c8f1818fdc45 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/240dacad-35f1-44fc-8654-5725b50c8dad" status: 200 len: 194 microversion: 2.1 time: 0.050968 Jul 15 16:03:11.583929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 521/1048] 10.222.0.98 () {58 vars in 1412 bytes} [Fri Jul 15 16:03:11 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/240dacad-35f1-44fc-8654-5725b50c8dad => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:11.594665 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-56a2b2b6-9b17-4b58-9025-653b3eef0df7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:11.595239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-56a2b2b6-9b17-4b58-9025-653b3eef0df7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:11.601372 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-56a2b2b6-9b17-4b58-9025-653b3eef0df7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:11.602364 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-56a2b2b6-9b17-4b58-9025-653b3eef0df7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:11.603119 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-56a2b2b6-9b17-4b58-9025-653b3eef0df7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:11.603719 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-56a2b2b6-9b17-4b58-9025-653b3eef0df7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:11.685451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-56a2b2b6-9b17-4b58-9025-653b3eef0df7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lazy-loading 'services' on Instance uuid 548a2776-957b-44bc-86c1-914102f3da94 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:03:11.946359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-56a2b2b6-9b17-4b58-9025-653b3eef0df7 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/240dacad-35f1-44fc-8654-5725b50c8dad" status: 202 len: 0 microversion: 2.1 time: 0.355179 Jul 15 16:03:11.947129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 528/1049] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:03:11 2022] DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments/240dacad-35f1-44fc-8654-5725b50c8dad => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:03:12.038981 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9acc908d-0cce-442d-842b-89e5f345f465 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:12.040249 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9acc908d-0cce-442d-842b-89e5f345f465 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:12.047647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9acc908d-0cce-442d-842b-89e5f345f465 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:12.048139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9acc908d-0cce-442d-842b-89e5f345f465 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:12.048915 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9acc908d-0cce-442d-842b-89e5f345f465 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:12.049354 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9acc908d-0cce-442d-842b-89e5f345f465 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:12.181980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9acc908d-0cce-442d-842b-89e5f345f465 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:12.192263 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9acc908d-0cce-442d-842b-89e5f345f465 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.156781 Jul 15 16:03:12.193332 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 522/1050] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:12 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:13.210337 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-713cf907-90c6-45dd-b0da-bfda5d829737 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:13.211039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-713cf907-90c6-45dd-b0da-bfda5d829737 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:13.213773 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:13.218877 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-713cf907-90c6-45dd-b0da-bfda5d829737 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:13.219401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-713cf907-90c6-45dd-b0da-bfda5d829737 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:13.220171 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-713cf907-90c6-45dd-b0da-bfda5d829737 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:13.220613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-713cf907-90c6-45dd-b0da-bfda5d829737 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:13.348514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-713cf907-90c6-45dd-b0da-bfda5d829737 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:13.355979 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-713cf907-90c6-45dd-b0da-bfda5d829737 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.149918 Jul 15 16:03:13.356991 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 529/1051] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:13 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:14.371911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c2ef6a05-271c-42cb-93ea-ec0eb72448cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:14.372539 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c2ef6a05-271c-42cb-93ea-ec0eb72448cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:14.375008 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:14.383315 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c2ef6a05-271c-42cb-93ea-ec0eb72448cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:14.383315 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c2ef6a05-271c-42cb-93ea-ec0eb72448cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:14.383315 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c2ef6a05-271c-42cb-93ea-ec0eb72448cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:14.383315 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c2ef6a05-271c-42cb-93ea-ec0eb72448cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:14.512330 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c2ef6a05-271c-42cb-93ea-ec0eb72448cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:14.519687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c2ef6a05-271c-42cb-93ea-ec0eb72448cf tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.151659 Jul 15 16:03:14.520251 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 523/1052] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:14 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:15.536586 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4d8df2e9-c0ac-40d2-8f76-8c950a8af073 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:15.537226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4d8df2e9-c0ac-40d2-8f76-8c950a8af073 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:15.540641 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=8 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:15.544492 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4d8df2e9-c0ac-40d2-8f76-8c950a8af073 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:15.544925 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4d8df2e9-c0ac-40d2-8f76-8c950a8af073 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:15.545710 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4d8df2e9-c0ac-40d2-8f76-8c950a8af073 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:15.546150 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4d8df2e9-c0ac-40d2-8f76-8c950a8af073 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:15.680084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4d8df2e9-c0ac-40d2-8f76-8c950a8af073 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:15.687448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4d8df2e9-c0ac-40d2-8f76-8c950a8af073 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.154750 Jul 15 16:03:15.688022 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 530/1053] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:15 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:16.262323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cf7e6d87-e9da-4cd4-9ca9-3918d52e5bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:16.263325 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cf7e6d87-e9da-4cd4-9ca9-3918d52e5bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:16.269793 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf7e6d87-e9da-4cd4-9ca9-3918d52e5bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.270245 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf7e6d87-e9da-4cd4-9ca9-3918d52e5bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.271015 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf7e6d87-e9da-4cd4-9ca9-3918d52e5bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.271487 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cf7e6d87-e9da-4cd4-9ca9-3918d52e5bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.299371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cf7e6d87-e9da-4cd4-9ca9-3918d52e5bc4 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041543 Jul 15 16:03:16.299918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 524/1054] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:03:16 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 16:03:16.405485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fcb8ac8a-ec57-4fd3-816a-20c2d3e57267 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:16.406453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fcb8ac8a-ec57-4fd3-816a-20c2d3e57267 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:16.412548 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac8a-ec57-4fd3-816a-20c2d3e57267 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.413006 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac8a-ec57-4fd3-816a-20c2d3e57267 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.413812 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac8a-ec57-4fd3-816a-20c2d3e57267 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.414320 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac8a-ec57-4fd3-816a-20c2d3e57267 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.442442 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fcb8ac8a-ec57-4fd3-816a-20c2d3e57267 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040947 Jul 15 16:03:16.442991 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 531/1055] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:03:16 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 16:03:16.510312 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ab634238-902b-4656-9066-f500afc89180 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:16.510918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ab634238-902b-4656-9066-f500afc89180 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:16.517168 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ab634238-902b-4656-9066-f500afc89180 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.517627 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ab634238-902b-4656-9066-f500afc89180 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.518574 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ab634238-902b-4656-9066-f500afc89180 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.519022 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ab634238-902b-4656-9066-f500afc89180 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.543715 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ab634238-902b-4656-9066-f500afc89180 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:03:16.704947 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ef20879e-c0b0-4d3a-a192-de99b8401616 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:16.705509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ef20879e-c0b0-4d3a-a192-de99b8401616 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:16.712134 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef20879e-c0b0-4d3a-a192-de99b8401616 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.712850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef20879e-c0b0-4d3a-a192-de99b8401616 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.715606 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef20879e-c0b0-4d3a-a192-de99b8401616 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.715606 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ef20879e-c0b0-4d3a-a192-de99b8401616 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.797424 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ab634238-902b-4656-9066-f500afc89180 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 204 len: 0 microversion: 2.1 time: 0.294279 Jul 15 16:03:16.798143 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 525/1056] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:03:16 2022] DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:03:16.807734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fbd682e2-0309-44ad-9485-7bb531d004f6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:16.808750 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fbd682e2-0309-44ad-9485-7bb531d004f6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:16.815039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbd682e2-0309-44ad-9485-7bb531d004f6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.815534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbd682e2-0309-44ad-9485-7bb531d004f6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.816315 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbd682e2-0309-44ad-9485-7bb531d004f6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.816752 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbd682e2-0309-44ad-9485-7bb531d004f6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:16.847268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ef20879e-c0b0-4d3a-a192-de99b8401616 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:16.855937 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ef20879e-c0b0-4d3a-a192-de99b8401616 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.154958 Jul 15 16:03:16.856513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 532/1057] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:16 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:03:16.950396 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fbd682e2-0309-44ad-9485-7bb531d004f6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:16.954808 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:16.959309 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fbd682e2-0309-44ad-9485-7bb531d004f6 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1672 microversion: 2.1 time: 0.156497 Jul 15 16:03:16.962962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 526/1058] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:16 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:16.982738 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-60788ab0-a09e-4477-8364-9e04830d60d3 req-2758e14a-b606-40ed-8229-bd6e08235cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65288e88-4533-4139-9d66-f83c022d57db", "name": "network-vif-plugged", "status": "completed", "tag": "e1246a30-532b-4be5-9b1f-e60c689fa115"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:16.991095 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-60788ab0-a09e-4477-8364-9e04830d60d3 req-2758e14a-b606-40ed-8229-bd6e08235cea service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:16.992328 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-60788ab0-a09e-4477-8364-9e04830d60d3 req-2758e14a-b606-40ed-8229-bd6e08235cea service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:17.002674 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-60788ab0-a09e-4477-8364-9e04830d60d3 req-2758e14a-b606-40ed-8229-bd6e08235cea service nova] Creating event network-vif-plugged:e1246a30-532b-4be5-9b1f-e60c689fa115 for instance 65288e88-4533-4139-9d66-f83c022d57db on hv-cinder-83587 Jul 15 16:03:17.007761 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-60788ab0-a09e-4477-8364-9e04830d60d3 req-2758e14a-b606-40ed-8229-bd6e08235cea service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031744 Jul 15 16:03:17.008333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 533/1059] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:17.788016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4476a08a-cc7f-4e68-9805-ed6c41c456e4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:17.788620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4476a08a-cc7f-4e68-9805-ed6c41c456e4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:17.796250 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4476a08a-cc7f-4e68-9805-ed6c41c456e4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:17.796790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4476a08a-cc7f-4e68-9805-ed6c41c456e4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:17.797598 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4476a08a-cc7f-4e68-9805-ed6c41c456e4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:17.798022 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4476a08a-cc7f-4e68-9805-ed6c41c456e4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:17.822474 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4476a08a-cc7f-4e68-9805-ed6c41c456e4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/ips" status: 200 len: 146 microversion: 2.1 time: 0.038689 Jul 15 16:03:17.823061 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 527/1060] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 16:03:17 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:17.874178 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c481713a-4cfd-4cdb-a354-4e4835cea6bb tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:17.874879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c481713a-4cfd-4cdb-a354-4e4835cea6bb tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:17.881174 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c481713a-4cfd-4cdb-a354-4e4835cea6bb tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:17.881625 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c481713a-4cfd-4cdb-a354-4e4835cea6bb tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:17.882407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c481713a-4cfd-4cdb-a354-4e4835cea6bb tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:17.883479 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c481713a-4cfd-4cdb-a354-4e4835cea6bb tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:17.980029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fe8fa130-b7b4-49aa-b1ec-3ff19a970bff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:17.981034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fe8fa130-b7b4-49aa-b1ec-3ff19a970bff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:17.987375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe8fa130-b7b4-49aa-b1ec-3ff19a970bff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:17.988062 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe8fa130-b7b4-49aa-b1ec-3ff19a970bff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:17.988843 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe8fa130-b7b4-49aa-b1ec-3ff19a970bff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:17.989335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe8fa130-b7b4-49aa-b1ec-3ff19a970bff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:18.021030 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c481713a-4cfd-4cdb-a354-4e4835cea6bb tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:18.028866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c481713a-4cfd-4cdb-a354-4e4835cea6bb tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.159297 Jul 15 16:03:18.035044 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 534/1061] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:17 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:18.125642 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fe8fa130-b7b4-49aa-b1ec-3ff19a970bff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:18.133265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fe8fa130-b7b4-49aa-b1ec-3ff19a970bff tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1672 microversion: 2.1 time: 0.159683 Jul 15 16:03:18.133833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 528/1062] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:17 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:03:19.046264 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-375ae9be-39b5-443a-8b4a-74bc626f1d56 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:19.046885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-375ae9be-39b5-443a-8b4a-74bc626f1d56 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:19.053508 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-375ae9be-39b5-443a-8b4a-74bc626f1d56 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:19.053960 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-375ae9be-39b5-443a-8b4a-74bc626f1d56 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:19.055333 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-375ae9be-39b5-443a-8b4a-74bc626f1d56 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:19.055785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-375ae9be-39b5-443a-8b4a-74bc626f1d56 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:19.150528 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4b43923c-2cd2-4f88-ab71-d8c616326097 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:19.151154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4b43923c-2cd2-4f88-ab71-d8c616326097 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:19.157727 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b43923c-2cd2-4f88-ab71-d8c616326097 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:19.158185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b43923c-2cd2-4f88-ab71-d8c616326097 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:19.158975 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b43923c-2cd2-4f88-ab71-d8c616326097 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:19.159450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b43923c-2cd2-4f88-ab71-d8c616326097 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:19.189691 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-375ae9be-39b5-443a-8b4a-74bc626f1d56 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:19.196067 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-375ae9be-39b5-443a-8b4a-74bc626f1d56 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.153812 Jul 15 16:03:19.196651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 535/1063] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:19 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:19.287844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4b43923c-2cd2-4f88-ab71-d8c616326097 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:19.295910 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4b43923c-2cd2-4f88-ab71-d8c616326097 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1672 microversion: 2.1 time: 0.149872 Jul 15 16:03:19.296527 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 529/1064] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:19 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:03:20.214336 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d7570356-eecb-4409-93e4-93674f6388ca tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:20.214960 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d7570356-eecb-4409-93e4-93674f6388ca tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:20.220926 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d7570356-eecb-4409-93e4-93674f6388ca tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:20.221383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d7570356-eecb-4409-93e4-93674f6388ca tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:20.222166 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d7570356-eecb-4409-93e4-93674f6388ca tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:20.222607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d7570356-eecb-4409-93e4-93674f6388ca tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:20.314207 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2930f25d-2932-48c1-901e-b2fbcd34fee8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:20.314773 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2930f25d-2932-48c1-901e-b2fbcd34fee8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:20.321886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2930f25d-2932-48c1-901e-b2fbcd34fee8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:20.322343 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2930f25d-2932-48c1-901e-b2fbcd34fee8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:20.323121 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2930f25d-2932-48c1-901e-b2fbcd34fee8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:20.323625 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2930f25d-2932-48c1-901e-b2fbcd34fee8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:20.452531 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d7570356-eecb-4409-93e4-93674f6388ca tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:20.459767 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2930f25d-2932-48c1-901e-b2fbcd34fee8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:20.460651 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d7570356-eecb-4409-93e4-93674f6388ca tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1317 microversion: 2.1 time: 0.251641 Jul 15 16:03:20.462104 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 536/1065] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:20 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:20.469739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2930f25d-2932-48c1-901e-b2fbcd34fee8 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1672 microversion: 2.1 time: 0.160265 Jul 15 16:03:20.470754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 530/1066] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:20 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:03:20.537967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-34f053af-523b-49b4-887f-d7044523f067 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:20.539035 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-34f053af-523b-49b4-887f-d7044523f067 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:20.545184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-34f053af-523b-49b4-887f-d7044523f067 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:20.548814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-34f053af-523b-49b4-887f-d7044523f067 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:20.548814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-34f053af-523b-49b4-887f-d7044523f067 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:20.548814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-34f053af-523b-49b4-887f-d7044523f067 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:20.919072 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-e40f2a3c-8683-4557-91e7-be22e846a19e req-72f0e455-67f4-4563-99d5-54b50e8a94dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548a2776-957b-44bc-86c1-914102f3da94", "name": "network-vif-deleted", "tag": "ffccd932-a128-4971-a815-73234a27c30d"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:20.927185 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-e40f2a3c-8683-4557-91e7-be22e846a19e req-72f0e455-67f4-4563-99d5-54b50e8a94dc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:20.927695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-e40f2a3c-8683-4557-91e7-be22e846a19e req-72f0e455-67f4-4563-99d5-54b50e8a94dc service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:20.946668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-e40f2a3c-8683-4557-91e7-be22e846a19e req-72f0e455-67f4-4563-99d5-54b50e8a94dc service nova] Creating event network-vif-deleted:ffccd932-a128-4971-a815-73234a27c30d for instance 548a2776-957b-44bc-86c1-914102f3da94 on hv-cinder-83587 Jul 15 16:03:20.951909 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-e40f2a3c-8683-4557-91e7-be22e846a19e req-72f0e455-67f4-4563-99d5-54b50e8a94dc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036535 Jul 15 16:03:20.953167 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 531/1067] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:03:21.284125 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:21.480330 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6c2a30c6-57d2-4b05-aace-21b949bc9d0d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:21.481051 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6c2a30c6-57d2-4b05-aace-21b949bc9d0d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:21.492516 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c2a30c6-57d2-4b05-aace-21b949bc9d0d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:21.492974 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c2a30c6-57d2-4b05-aace-21b949bc9d0d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:21.493758 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c2a30c6-57d2-4b05-aace-21b949bc9d0d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:21.494202 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c2a30c6-57d2-4b05-aace-21b949bc9d0d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:21.494306 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-34f053af-523b-49b4-887f-d7044523f067 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959885 Jul 15 16:03:21.494884 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 537/1068] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 16:03:20 2022] POST /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments => generated 194 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:21.500721 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:21.501551 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:21.510039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:21.510570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:21.511458 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:21.512038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:21.549412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:21.551330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:21.551330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lazy-loading 'fault' on Instance uuid 548a2776-957b-44bc-86c1-914102f3da94 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:03:21.601746 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78db558bb3ea4161b4a54e62f9ec3bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e4d5ff424c4e4fa5dd81c20cc920d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:21.609995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-97c5565c-7b11-4a2d-a3a5-7653909e2d35 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 200 len: 1327 microversion: 2.1 time: 0.113395 Jul 15 16:03:21.610568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 538/1069] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:21 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:21.654160 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6c2a30c6-57d2-4b05-aace-21b949bc9d0d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:21.662069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6c2a30c6-57d2-4b05-aace-21b949bc9d0d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1505 microversion: 2.1 time: 0.187510 Jul 15 16:03:21.662561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 532/1070] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:21 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:03:22.627798 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:22.628484 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:22.636087 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:22.640745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:22.640745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:22.640745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:22.651650 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] HTTP exception thrown: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Request method failure captured: Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 HTTP/1.1 Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y1511LF_p46wKK5lPQnP9mviJ1x-YV_2kGMRZK8hcX7ajmmSHUVEGa3-Tp2sp_EdLgVGBk-unJCaarXnxlws3i4PxFzwI3TAQWOxuFQrv4iQHd3-3wUnwmY6GbQVEIX-09kMeRxf6kI67exka8zRtmlieza0GoMghOZcoHAM0_eRcg Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:03:22.653307 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 78db558bb3ea4161b4a54e62f9ec3bd6 Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:22.655092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '548a2776-957b-44bc-86c1-914102f3da94'} Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:22.655933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:22.657203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:22.658360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Returning 404 to user: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:22.658360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-cb26364a-e44f-4dc5-9690-c2e8ac321505 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 404 len: 111 microversion: 2.1 time: 0.030877 Jul 15 16:03:22.658360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 539/1071] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:22 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 16:03:22.664389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6c1f1f62-a6ea-4ddb-905a-825d9dc38ba3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '.version_select at 0x7f510a92fee0>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:22.670771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:22.741485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6c1f1f62-a6ea-4ddb-905a-825d9dc38ba3 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-177031013" status: 202 len: 0 microversion: 2.1 time: 0.081666 Jul 15 16:03:22.742803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 533/1072] 10.222.0.98 () {58 vars in 1217 bytes} [Fri Jul 15 16:03:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-177031013 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:03:26.066973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:26.066973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:26.066973 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:26.067700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:26.067941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:26.068378 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:26.082050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] HTTP exception thrown: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Request method failure captured: Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 HTTP/1.1 Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y1511LF_p46wKK5lPQnP9mviJ1x-YV_2kGMRZK8hcX7ajmmSHUVEGa3-Tp2sp_EdLgVGBk-unJCaarXnxlws3i4PxFzwI3TAQWOxuFQrv4iQHd3-3wUnwmY6GbQVEIX-09kMeRxf6kI67exka8zRtmlieza0GoMghOZcoHAM0_eRcg Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:03:26.083681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 78db558bb3ea4161b4a54e62f9ec3bd6 Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.085344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '548a2776-957b-44bc-86c1-914102f3da94'} Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:26.086513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.089332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.091044 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Returning 404 to user: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:26.091044 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-901d3f7c-678d-4443-938b-b7cf88c6c32f tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 404 len: 111 microversion: 2.1 time: 0.029777 Jul 15 16:03:26.091044 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 540/1073] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:03:26 2022] DELETE /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:03:26.095990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:26.096626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 548a2776-957b-44bc-86c1-914102f3da94] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:26.102720 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:26.103763 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:26.104544 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:26.104992 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:26.119674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] HTTP exception thrown: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Request method failure captured: Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 HTTP/1.1 Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y1511LF_p46wKK5lPQnP9mviJ1x-YV_2kGMRZK8hcX7ajmmSHUVEGa3-Tp2sp_EdLgVGBk-unJCaarXnxlws3i4PxFzwI3TAQWOxuFQrv4iQHd3-3wUnwmY6GbQVEIX-09kMeRxf6kI67exka8zRtmlieza0GoMghOZcoHAM0_eRcg Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:03:26.121397 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 78db558bb3ea4161b4a54e62f9ec3bd6 Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.123139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '548a2776-957b-44bc-86c1-914102f3da94'} Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:26.141744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. Jul 15 16:03:26.143522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:26.144946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Returning 404 to user: Instance 548a2776-957b-44bc-86c1-914102f3da94 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:26.144946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-24034fb8-5b5b-49d9-bcae-43fd5b851c34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94" status: 404 len: 111 microversion: 2.1 time: 0.032130 Jul 15 16:03:26.144946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 534/1074] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:26 2022] GET /compute/v2.1/servers/548a2776-957b-44bc-86c1-914102f3da94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:03:27.578500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:27.579010 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:27.585920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:27.586365 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:27.587146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:27.587617 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:27.602744 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] HTTP exception thrown: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Request method failure captured: Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 HTTP/1.1 Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y1511LF_p46wKK5lPQnP9mviJ1x-YV_2kGMRZK8hcX7ajmmSHUVEGa3-Tp2sp_EdLgVGBk-unJCaarXnxlws3i4PxFzwI3TAQWOxuFQrv4iQHd3-3wUnwmY6GbQVEIX-09kMeRxf6kI67exka8zRtmlieza0GoMghOZcoHAM0_eRcg Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:03:27.604362 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 78db558bb3ea4161b4a54e62f9ec3bd6 Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.605972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '5d25c85d-d076-40e3-81e3-1a9c6a6a1968'} Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:27.606780 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.608209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.609542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Returning 404 to user: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:27.609542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-84dde2a4-72e3-4a75-9bd9-67200b547d59 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 404 len: 111 microversion: 2.1 time: 0.031141 Jul 15 16:03:27.609542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 541/1075] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:03:27 2022] DELETE /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:03:27.614661 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:27.615425 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] [instance: 5d25c85d-d076-40e3-81e3-1a9c6a6a1968] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:27.622836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:27.623331 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:27.624117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:27.624554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:27.639959 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] HTTP exception thrown: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Request method failure captured: Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 HTTP/1.1 Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y1511LF_p46wKK5lPQnP9mviJ1x-YV_2kGMRZK8hcX7ajmmSHUVEGa3-Tp2sp_EdLgVGBk-unJCaarXnxlws3i4PxFzwI3TAQWOxuFQrv4iQHd3-3wUnwmY6GbQVEIX-09kMeRxf6kI67exka8zRtmlieza0GoMghOZcoHAM0_eRcg Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:03:27.641422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93e4d5ff424c4e4fa5dd81c20cc920d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 93e4d5ff424c4e4fa5dd81c20cc920d0 Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1812749299 Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 78db558bb3ea4161b4a54e62f9ec3bd6 Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeTestJSON-1812749299-project Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.643048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '5d25c85d-d076-40e3-81e3-1a9c6a6a1968'} Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:27.647668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. Jul 15 16:03:27.649237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:27.650911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] Returning 404 to user: Instance 5d25c85d-d076-40e3-81e3-1a9c6a6a1968 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:27.650911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0c4bc91f-0bf5-47f4-aeab-281274aa2e34 tempest-AttachVolumeTestJSON-1812749299 tempest-AttachVolumeTestJSON-1812749299-project] 10.222.0.98 "GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968" status: 404 len: 111 microversion: 2.1 time: 0.032037 Jul 15 16:03:27.650911 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 535/1076] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:27 2022] GET /compute/v2.1/servers/5d25c85d-d076-40e3-81e3-1a9c6a6a1968 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:03:28.495032 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 15 16:03:28.498790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:03:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:03:30.127970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:30.129459 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:30.137233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:30.137697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:30.138504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:30.138945 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:30.228794 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Invalid volume: volume 4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a is already attached to instances: bd957115-e1c8-4716-82fa-73ca85975a93 Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: POST /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments HTTP/1.1 Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 74 Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:03:30.230726 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {"volumeAttachment": {"volumeId": "4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a"}} Jul 15 16:03:30.232383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Invalid volume: volume 4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a is already attached to instances: bd957115-e1c8-4716-82fa-73ca85975a93 Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'server_id': 'bd957115-e1c8-4716-82fa-73ca85975a93', 'body': {'volumeAttachment': {'volumeId': '4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a'}}} Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a is already attached to instances: bd957115-e1c8-4716-82fa-73ca85975a93 Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:30.233291 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a is already attached to instances: bd957115-e1c8-4716-82fa-73ca85975a93 Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:30.234640 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:30.236068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:30.236068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:30.236068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:30.236068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a is already attached to instances: bd957115-e1c8-4716-82fa-73ca85975a93 Jul 15 16:03:30.236068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:30.236068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 400 to user: Invalid volume: volume 4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a is already attached to instances: bd957115-e1c8-4716-82fa-73ca85975a93 {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:30.236068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c19da54b-f358-4d10-a218-e13e1a613bca tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109329 Jul 15 16:03:30.238248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 542/1077] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 16:03:30 2022] POST /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 16:03:30.312756 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c6488aaa-575b-4f6c-a4c7-53522fddde98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:30.313590 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c6488aaa-575b-4f6c-a4c7-53522fddde98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:30.321521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6488aaa-575b-4f6c-a4c7-53522fddde98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:30.322512 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6488aaa-575b-4f6c-a4c7-53522fddde98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:30.323319 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6488aaa-575b-4f6c-a4c7-53522fddde98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:30.323842 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c6488aaa-575b-4f6c-a4c7-53522fddde98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:30.430229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-c6488aaa-575b-4f6c-a4c7-53522fddde98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lazy-loading 'services' on Instance uuid bd957115-e1c8-4716-82fa-73ca85975a93 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:03:30.659467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c6488aaa-575b-4f6c-a4c7-53522fddde98 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments/4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a" status: 202 len: 0 microversion: 2.1 time: 0.360604 Jul 15 16:03:30.660699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 536/1078] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:03:30 2022] DELETE /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments/4c6e94f3-edf4-4ae2-9f82-60ad7a4fb34a => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:03:30.669331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f03d4fed-d5e5-4e58-bcd3-beca92a2ce6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:30.670485 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f03d4fed-d5e5-4e58-bcd3-beca92a2ce6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:30.674487 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:03:30.675035 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 16:03:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments (ip 10.222.0.98) !!! Jul 15 16:03:30.692883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f03d4fed-d5e5-4e58-bcd3-beca92a2ce6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:30.692883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f03d4fed-d5e5-4e58-bcd3-beca92a2ce6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:30.692883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f03d4fed-d5e5-4e58-bcd3-beca92a2ce6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:30.692883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f03d4fed-d5e5-4e58-bcd3-beca92a2ce6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:30.723724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f03d4fed-d5e5-4e58-bcd3-beca92a2ce6c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058823 Jul 15 16:03:30.725599 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 543/1079] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:03:30 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:31.735953 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9839e32d-1d55-4cef-9441-7b420a4ce2a8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:31.737094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9839e32d-1d55-4cef-9441-7b420a4ce2a8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:31.744214 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9839e32d-1d55-4cef-9441-7b420a4ce2a8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:31.744871 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9839e32d-1d55-4cef-9441-7b420a4ce2a8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:31.745718 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9839e32d-1d55-4cef-9441-7b420a4ce2a8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:31.746163 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9839e32d-1d55-4cef-9441-7b420a4ce2a8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:31.777359 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9839e32d-1d55-4cef-9441-7b420a4ce2a8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Jul 15 16:03:31.781294 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 537/1080] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:03:31 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:32.789198 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-11eccf5d-bc84-4fd8-b0f1-e46f162014ee tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:32.790129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-11eccf5d-bc84-4fd8-b0f1-e46f162014ee tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:32.792669 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:32.797515 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-11eccf5d-bc84-4fd8-b0f1-e46f162014ee tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:32.798009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-11eccf5d-bc84-4fd8-b0f1-e46f162014ee tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:32.798786 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-11eccf5d-bc84-4fd8-b0f1-e46f162014ee tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:32.799227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-11eccf5d-bc84-4fd8-b0f1-e46f162014ee tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:32.831756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-11eccf5d-bc84-4fd8-b0f1-e46f162014ee tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046497 Jul 15 16:03:32.832330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 544/1081] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:03:32 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 16:03:32.894465 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-13a3026c-76a5-481c-8373-d05dc1ab3aea tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:32.895173 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-13a3026c-76a5-481c-8373-d05dc1ab3aea tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:32.901990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-13a3026c-76a5-481c-8373-d05dc1ab3aea tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:32.902446 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-13a3026c-76a5-481c-8373-d05dc1ab3aea tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:32.906465 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-13a3026c-76a5-481c-8373-d05dc1ab3aea tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:32.906465 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-13a3026c-76a5-481c-8373-d05dc1ab3aea tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:32.930263 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-13a3026c-76a5-481c-8373-d05dc1ab3aea tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:03:33.237049 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-13a3026c-76a5-481c-8373-d05dc1ab3aea tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 204 len: 0 microversion: 2.1 time: 0.348074 Jul 15 16:03:33.237647 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 538/1082] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:03:32 2022] DELETE /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:03:33.246267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6fdc4964-5a3c-4b75-b7e8-d2d2ed4df21f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:33.247193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6fdc4964-5a3c-4b75-b7e8-d2d2ed4df21f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:33.253981 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6fdc4964-5a3c-4b75-b7e8-d2d2ed4df21f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:33.254432 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6fdc4964-5a3c-4b75-b7e8-d2d2ed4df21f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:33.255203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6fdc4964-5a3c-4b75-b7e8-d2d2ed4df21f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:33.255674 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6fdc4964-5a3c-4b75-b7e8-d2d2ed4df21f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:33.619184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6fdc4964-5a3c-4b75-b7e8-d2d2ed4df21f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:33.627074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6fdc4964-5a3c-4b75-b7e8-d2d2ed4df21f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1678 microversion: 2.1 time: 0.384968 Jul 15 16:03:33.627813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 545/1083] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:33 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1678 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:03:34.647564 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-66960a66-8621-4ba7-b3cb-e2367267382e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:34.648190 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-66960a66-8621-4ba7-b3cb-e2367267382e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:34.654952 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-66960a66-8621-4ba7-b3cb-e2367267382e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:34.655436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-66960a66-8621-4ba7-b3cb-e2367267382e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:34.656210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-66960a66-8621-4ba7-b3cb-e2367267382e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:34.656645 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-66960a66-8621-4ba7-b3cb-e2367267382e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:34.951079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-66960a66-8621-4ba7-b3cb-e2367267382e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:34.958883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-66960a66-8621-4ba7-b3cb-e2367267382e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1678 microversion: 2.1 time: 0.315583 Jul 15 16:03:34.959500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 539/1084] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:34 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1678 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:35.976883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d2c0fdca-dada-4423-b293-ce3bb1a6cc3c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:35.977632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d2c0fdca-dada-4423-b293-ce3bb1a6cc3c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:35.984472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d2c0fdca-dada-4423-b293-ce3bb1a6cc3c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:35.985005 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d2c0fdca-dada-4423-b293-ce3bb1a6cc3c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:35.985868 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d2c0fdca-dada-4423-b293-ce3bb1a6cc3c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:35.986381 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d2c0fdca-dada-4423-b293-ce3bb1a6cc3c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:36.219758 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-d2c0fdca-dada-4423-b293-ce3bb1a6cc3c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:36.228539 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d2c0fdca-dada-4423-b293-ce3bb1a6cc3c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1678 microversion: 2.1 time: 0.255600 Jul 15 16:03:36.229476 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 546/1085] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:35 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:36.698170 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-5bbace54-29ca-4b06-8fc6-c7224c2393f1 req-bd714d5a-383c-46d0-9e25-2c8f4d6d6fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd957115-e1c8-4716-82fa-73ca85975a93", "name": "network-vif-deleted", "tag": "9bd50bc2-c176-4cb7-a0a2-6b8557815227"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:36.707021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-5bbace54-29ca-4b06-8fc6-c7224c2393f1 req-bd714d5a-383c-46d0-9e25-2c8f4d6d6fa7 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:36.707502 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-5bbace54-29ca-4b06-8fc6-c7224c2393f1 req-bd714d5a-383c-46d0-9e25-2c8f4d6d6fa7 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:36.719739 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-5bbace54-29ca-4b06-8fc6-c7224c2393f1 req-bd714d5a-383c-46d0-9e25-2c8f4d6d6fa7 service nova] Creating event network-vif-deleted:9bd50bc2-c176-4cb7-a0a2-6b8557815227 for instance bd957115-e1c8-4716-82fa-73ca85975a93 on hv-cinder-83587 Jul 15 16:03:36.724863 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-5bbace54-29ca-4b06-8fc6-c7224c2393f1 req-bd714d5a-383c-46d0-9e25-2c8f4d6d6fa7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030959 Jul 15 16:03:36.725542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 540/1086] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:37.249439 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:37.250381 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:37.257278 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:37.257826 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:37.258707 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:37.259902 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:37.293339 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:37.293793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:37.294252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lazy-loading 'fault' on Instance uuid bd957115-e1c8-4716-82fa-73ca85975a93 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:03:37.337223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:37.345717 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-017b2cc4-a79c-443e-8e8b-05a6a2183c5e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 200 len: 1332 microversion: 2.1 time: 0.100185 Jul 15 16:03:37.355382 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 547/1087] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:37 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:38.366618 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:38.367335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:38.375930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:38.376395 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:38.377322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:38.377781 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:38.391710 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 HTTP/1.1 Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:03:38.393361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:03:38.394906 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': 'bd957115-e1c8-4716-82fa-73ca85975a93'} Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:38.395873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:03:38.397421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:38.398856 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:38.398856 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a88d5153-d72b-47fd-96fc-eed6ec8f05c9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 404 len: 111 microversion: 2.1 time: 0.033043 Jul 15 16:03:38.398856 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 541/1088] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:38 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:03:38.403921 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-65baf93e-717a-499e-98f5-f38fd42bdf56 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '.version_select at 0x7f510a9fbdc0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:38.518592 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-65baf93e-717a-499e-98f5-f38fd42bdf56 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147808282" status: 202 len: 0 microversion: 2.1 time: 0.118483 Jul 15 16:03:38.519380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 548/1089] 10.222.0.98 () {58 vars in 1220 bytes} [Fri Jul 15 16:03:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147808282 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:03:39.387138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-904edae7-cdcc-45d3-bdb1-4bb7dffc687a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: .version_select at 0x7f510aa64670>, body: {"keypair": {"name": "tempest-keypair-791723333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1O4Vxv5Y5UtHWMqInH9Lx2f7QCUEqb58+5WrbUUJfm5PRrLkuhx+TI4dtayGCkq+CYjevfCDsIwB2NTXknGQY0aM31o7ciCvjeD2EgooU1md6WTrxOB+I4ezWzrqAMAQ=="}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:39.402083 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-904edae7-cdcc-45d3-bdb1-4bb7dffc687a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for project c35d3e93d36040bba1bbb873e61d239a. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:03:39.406309 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-904edae7-cdcc-45d3-bdb1-4bb7dffc687a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for user 1157b91a306540dd98a072b1ea4941b2 and project c35d3e93d36040bba1bbb873e61d239a. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:03:39.493285 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-904edae7-cdcc-45d3-bdb1-4bb7dffc687a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111000 Jul 15 16:03:39.493919 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 542/1090] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 16:03:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:42.350438 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-942628494", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0ec6ba6-6b6c-449a-8ed1-834796a501b5"}], "security_groups": [{"name": "tempest-securitygroup--1599736433"}], "key_name": "tempest-keypair-791723333", "user_data": "}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:42.515393 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] validate_networks() for [('a0ec6ba6-6b6c-449a-8ed1-834796a501b5', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:03:42.817275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-883ad6f0-9911-4076-a0b5-07041c3f0fa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:42.818283 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-883ad6f0-9911-4076-a0b5-07041c3f0fa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:42.826024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-883ad6f0-9911-4076-a0b5-07041c3f0fa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:42.826565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-883ad6f0-9911-4076-a0b5-07041c3f0fa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:42.827467 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-883ad6f0-9911-4076-a0b5-07041c3f0fa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:42.827984 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-883ad6f0-9911-4076-a0b5-07041c3f0fa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:42.865548 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-883ad6f0-9911-4076-a0b5-07041c3f0fa2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052749 Jul 15 16:03:42.866444 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 543/1091] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Jul 15 16:03:42 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:03:42.929290 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fe886629-3681-463c-b608-884fc3a6903b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:42.929863 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fe886629-3681-463c-b608-884fc3a6903b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:42.936095 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe886629-3681-463c-b608-884fc3a6903b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:42.936551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe886629-3681-463c-b608-884fc3a6903b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:42.937326 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe886629-3681-463c-b608-884fc3a6903b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:42.937764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe886629-3681-463c-b608-884fc3a6903b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:42.963597 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fe886629-3681-463c-b608-884fc3a6903b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:03:42.978813 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:03:42.979243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:03:42.979763 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:03:42.980173 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:03:42.980588 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:03:42.989438 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:42.989893 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:42.990697 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:42.991136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:43.007714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for project c35d3e93d36040bba1bbb873e61d239a. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:03:43.012200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Getting quotas for user 1157b91a306540dd98a072b1ea4941b2 and project c35d3e93d36040bba1bbb873e61d239a. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:03:43.023098 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:03:43.031406 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:03:43.164762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-47b0028f-a10e-46ec-8752-b2a8bedc6c89 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.819685 Jul 15 16:03:43.170960 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 549/1092] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:03:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 16:03:43.176450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-10c308be-5002-4df6-b1f9-d3964768752d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:43.177146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-10c308be-5002-4df6-b1f9-d3964768752d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:43.242142 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-10c308be-5002-4df6-b1f9-d3964768752d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:43.249352 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-10c308be-5002-4df6-b1f9-d3964768752d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1240 microversion: 2.1 time: 0.076821 Jul 15 16:03:43.249923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 550/1093] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:43 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:43.443736 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fe886629-3681-463c-b608-884fc3a6903b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 204 len: 0 microversion: 2.20 time: 0.514665 Jul 15 16:03:43.443736 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 544/1094] 10.222.0.98 () {60 vars in 1279 bytes} [Fri Jul 15 16:03:42 2022] DELETE /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 15 16:03:43.449100 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:43.449796 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:43.456381 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:43.456838 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:43.457608 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:43.458046 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:43.592471 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:43.600850 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:43.602358 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:43.604097 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-63a8d5f3-813f-4cc9-9093-319a2d6db31b tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.158838 Jul 15 16:03:43.604658 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 551/1095] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:03:43 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:03:44.266573 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f3892046-6b1b-47dc-94d7-93c25857dea4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:44.267316 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f3892046-6b1b-47dc-94d7-93c25857dea4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:44.273810 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f3892046-6b1b-47dc-94d7-93c25857dea4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:44.274256 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f3892046-6b1b-47dc-94d7-93c25857dea4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:44.275661 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f3892046-6b1b-47dc-94d7-93c25857dea4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:44.276102 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f3892046-6b1b-47dc-94d7-93c25857dea4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:44.280197 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:44.338763 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f3892046-6b1b-47dc-94d7-93c25857dea4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:44.346427 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f3892046-6b1b-47dc-94d7-93c25857dea4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1244 microversion: 2.1 time: 0.084146 Jul 15 16:03:44.347194 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 545/1096] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:44 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:44.622385 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:44.627920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:44.630222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:44.630682 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:44.631567 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:44.632016 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:44.765913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:44.773942 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:44.775463 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:44.776608 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-76e4cbe2-addf-4a5b-8bb0-de3c2cd8d2eb tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.158636 Jul 15 16:03:44.777217 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 552/1097] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:03:44 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:03:45.362893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f6b35210-1c54-49a5-ae66-455015ffcc4d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:45.363655 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f6b35210-1c54-49a5-ae66-455015ffcc4d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:45.370877 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f6b35210-1c54-49a5-ae66-455015ffcc4d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:45.371398 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f6b35210-1c54-49a5-ae66-455015ffcc4d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:45.372182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f6b35210-1c54-49a5-ae66-455015ffcc4d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:45.372618 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f6b35210-1c54-49a5-ae66-455015ffcc4d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:45.438305 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f6b35210-1c54-49a5-ae66-455015ffcc4d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:45.445503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f6b35210-1c54-49a5-ae66-455015ffcc4d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1292 microversion: 2.1 time: 0.086828 Jul 15 16:03:45.446070 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 546/1098] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:45 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:45.793830 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:45.794444 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:45.800993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:45.801445 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:45.802210 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:45.802648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:45.972105 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:45.982617 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:45.984237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:45.985454 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-eba9c065-7c74-45bd-bd93-1c6a03a2cd46 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1721 microversion: 2.20 time: 0.195465 Jul 15 16:03:45.986010 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 553/1099] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:03:45 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:03:46.479265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-26d7de16-7408-47d2-b890-c9630f986b5c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:46.479265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-26d7de16-7408-47d2-b890-c9630f986b5c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:46.479265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-26d7de16-7408-47d2-b890-c9630f986b5c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:46.479265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-26d7de16-7408-47d2-b890-c9630f986b5c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:46.480023 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-26d7de16-7408-47d2-b890-c9630f986b5c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:46.480023 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-26d7de16-7408-47d2-b890-c9630f986b5c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:46.833415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-26d7de16-7408-47d2-b890-c9630f986b5c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:46.849086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-26d7de16-7408-47d2-b890-c9630f986b5c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1300 microversion: 2.1 time: 0.390325 Jul 15 16:03:46.852323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 547/1100] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:46 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1300 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:46.882213 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-f23612cd-574d-485d-bd18-fa07722070bd req-51e74f2e-9516-4af8-8950-1ff048146d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6551bf2-1fcd-4a78-8a1a-2965321d67cb", "name": "network-vif-deleted", "tag": "83f76815-bc46-4425-9b12-ba30c2ba8bd0"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:46.891678 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f23612cd-574d-485d-bd18-fa07722070bd req-51e74f2e-9516-4af8-8950-1ff048146d52 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:46.892160 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-f23612cd-574d-485d-bd18-fa07722070bd req-51e74f2e-9516-4af8-8950-1ff048146d52 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:46.908529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-f23612cd-574d-485d-bd18-fa07722070bd req-51e74f2e-9516-4af8-8950-1ff048146d52 service nova] Creating event network-vif-deleted:83f76815-bc46-4425-9b12-ba30c2ba8bd0 for instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb on hv-cinder-83587 Jul 15 16:03:46.914644 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-f23612cd-574d-485d-bd18-fa07722070bd req-51e74f2e-9516-4af8-8950-1ff048146d52 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036778 Jul 15 16:03:46.916004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 554/1101] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:47.007965 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:47.009239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:47.019366 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:47.020345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:47.021463 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:47.022176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:47.154215 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:47.163736 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:47.168010 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:47.169610 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-17110ba7-4b2a-4bbf-9478-7b7c8a2be5c0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1654 microversion: 2.20 time: 0.169606 Jul 15 16:03:47.180324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 548/1102] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:03:46 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1654 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:03:47.789479 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-d06b68a6-2bf7-47a8-b176-fc6b5560eb6c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21dc8889-1232-44c5-930b-98c902b1967b", "device": "/dev/sdb"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:47.791527 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-d06b68a6-2bf7-47a8-b176-fc6b5560eb6c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:47.799729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d06b68a6-2bf7-47a8-b176-fc6b5560eb6c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:47.800235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d06b68a6-2bf7-47a8-b176-fc6b5560eb6c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:47.801075 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d06b68a6-2bf7-47a8-b176-fc6b5560eb6c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:47.801435 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-d06b68a6-2bf7-47a8-b176-fc6b5560eb6c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:47.869644 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cd2bb107-d7f9-4fb3-be7e-8964b230cdfc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:47.870931 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cd2bb107-d7f9-4fb3-be7e-8964b230cdfc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:47.880496 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cd2bb107-d7f9-4fb3-be7e-8964b230cdfc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:47.881053 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cd2bb107-d7f9-4fb3-be7e-8964b230cdfc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:47.884681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cd2bb107-d7f9-4fb3-be7e-8964b230cdfc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:47.885719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cd2bb107-d7f9-4fb3-be7e-8964b230cdfc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:48.151056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cd2bb107-d7f9-4fb3-be7e-8964b230cdfc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:48.161025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cd2bb107-d7f9-4fb3-be7e-8964b230cdfc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.295719 Jul 15 16:03:48.161874 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 549/1103] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:47 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:03:48.188073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:48.188764 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:48.194831 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:48.195334 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:48.196097 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:48.196542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:48.229435 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:48.229883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:48.230408 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lazy-loading 'fault' on Instance uuid f6551bf2-1fcd-4a78-8a1a-2965321d67cb {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:03:48.309221 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:48.316556 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:48.318061 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac8dfa5c97594e74a6839d91b292adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1ad577ddf4dc8a9a75ad1a1337ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:48.319231 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-265ab86e-0725-41e8-b14a-347bacca7da9 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 200 len: 1370 microversion: 2.20 time: 0.135131 Jul 15 16:03:48.319834 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 550/1104] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:03:48 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 1370 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 16:03:48.849566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-d06b68a6-2bf7-47a8-b176-fc6b5560eb6c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "POST /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.061132 Jul 15 16:03:48.849566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 555/1105] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 16:03:47 2022] POST /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db/os-volume_attachments => generated 194 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:48.921599 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-1bd360f7-0bc1-415e-8109-bf374f3a77d2 req-94bec18c-263d-4c4d-99c7-2f2cd9139a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457", "tag": "12137d07-ce46-4b7b-aa5b-b78b14eede08"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:48.932875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-1bd360f7-0bc1-415e-8109-bf374f3a77d2 req-94bec18c-263d-4c4d-99c7-2f2cd9139a96 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:48.933485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-1bd360f7-0bc1-415e-8109-bf374f3a77d2 req-94bec18c-263d-4c4d-99c7-2f2cd9139a96 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:48.947685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-1bd360f7-0bc1-415e-8109-bf374f3a77d2 req-94bec18c-263d-4c4d-99c7-2f2cd9139a96 service nova] Creating event network-changed:12137d07-ce46-4b7b-aa5b-b78b14eede08 for instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 on hv-cinder-83587 Jul 15 16:03:48.960872 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-1bd360f7-0bc1-415e-8109-bf374f3a77d2 req-94bec18c-263d-4c4d-99c7-2f2cd9139a96 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043396 Jul 15 16:03:48.965402 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 551/1106] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:49.182388 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e1e720db-9661-4172-9370-bb874966a5ce tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:49.182388 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e1e720db-9661-4172-9370-bb874966a5ce tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:49.188155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e1e720db-9661-4172-9370-bb874966a5ce tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:49.188628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e1e720db-9661-4172-9370-bb874966a5ce tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:49.189404 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e1e720db-9661-4172-9370-bb874966a5ce tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:49.189849 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e1e720db-9661-4172-9370-bb874966a5ce tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:49.326977 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e1e720db-9661-4172-9370-bb874966a5ce tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:49.342534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e1e720db-9661-4172-9370-bb874966a5ce tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.159454 Jul 15 16:03:49.342534 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 556/1107] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:49 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:49.342808 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:49.342808 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:49.346016 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:49.346465 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:49.347264 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:49.347746 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:49.361528 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] HTTP exception thrown: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Request method failure captured: Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb HTTP/1.1 Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y15rT1TIsyB6A89MFOty6Zakg8zgEnifp-iXDBQP0iccrXigikyz1BLgJ2WGC555CIHZmLHzHcWOokfrgFvW1D-OdIo1YZYQ175lSNj5WlEZbie2rY0l87a0y-v2XAwpddEHIWhfBm4yGvgQ_MtSCk53noXhDd_HBMh7Xw27e7yldk Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:03:49.363200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: ac8dfa5c97594e74a6839d91b292adcd Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:49.364726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': 'f6551bf2-1fcd-4a78-8a1a-2965321d67cb'} Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:49.365546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:49.367132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:49.369959 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Returning 404 to user: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:49.369959 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ec771f17-5028-49d8-9620-0388a194bba5 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 404 len: 111 microversion: 2.20 time: 0.031060 Jul 15 16:03:49.369959 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 552/1108] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:03:49 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 15 16:03:49.376574 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9b549a7f-f1d9-448b-be41-b8a40378c3f0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '.version_select at 0x7f510a828310>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:49.479202 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9b549a7f-f1d9-448b-be41-b8a40378c3f0 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625398295" status: 204 len: 0 microversion: 2.20 time: 0.106355 Jul 15 16:03:49.480227 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 557/1109] 10.222.0.98 () {60 vars in 1258 bytes} [Fri Jul 15 16:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625398295 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 16:03:50.351964 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c36c8437-7ace-4fa3-8bfd-6b45ae1e56ed tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:50.352606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c36c8437-7ace-4fa3-8bfd-6b45ae1e56ed tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:50.354591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=4 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:50.359912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c36c8437-7ace-4fa3-8bfd-6b45ae1e56ed tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:50.360364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c36c8437-7ace-4fa3-8bfd-6b45ae1e56ed tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:50.361139 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c36c8437-7ace-4fa3-8bfd-6b45ae1e56ed tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:50.361577 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c36c8437-7ace-4fa3-8bfd-6b45ae1e56ed tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:50.500685 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c36c8437-7ace-4fa3-8bfd-6b45ae1e56ed tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:50.508313 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c36c8437-7ace-4fa3-8bfd-6b45ae1e56ed tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.160161 Jul 15 16:03:50.509406 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 553/1110] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:50 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:51.525621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2fcd57d2-6ce7-4f26-88c8-9efcbf69996f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:51.526224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2fcd57d2-6ce7-4f26-88c8-9efcbf69996f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:51.532299 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2fcd57d2-6ce7-4f26-88c8-9efcbf69996f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:51.532760 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2fcd57d2-6ce7-4f26-88c8-9efcbf69996f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:51.533531 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2fcd57d2-6ce7-4f26-88c8-9efcbf69996f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:51.533994 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2fcd57d2-6ce7-4f26-88c8-9efcbf69996f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:51.552598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:51.631196 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:51.631948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:51.639200 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:51.639704 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:51.640675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:51.641173 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:51.655209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] HTTP exception thrown: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Request method failure captured: Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: DELETE /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb HTTP/1.1 Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y15rT1TIsyB6A89MFOty6Zakg8zgEnifp-iXDBQP0iccrXigikyz1BLgJ2WGC555CIHZmLHzHcWOokfrgFvW1D-OdIo1YZYQ175lSNj5WlEZbie2rY0l87a0y-v2XAwpddEHIWhfBm4yGvgQ_MtSCk53noXhDd_HBMh7Xw27e7yldk Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:03:51.656812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: ac8dfa5c97594e74a6839d91b292adcd Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.658513 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': 'f6551bf2-1fcd-4a78-8a1a-2965321d67cb'} Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:51.659923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.661409 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.663820 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Returning 404 to user: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:51.663820 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6c4a277e-2daa-4974-b237-f46fa0765076 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 404 len: 111 microversion: 2.20 time: 0.031032 Jul 15 16:03:51.663820 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 554/1111] 10.222.0.98 () {60 vars in 1279 bytes} [Fri Jul 15 16:03:51 2022] DELETE /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 16:03:51.667061 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:51.667699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: f6551bf2-1fcd-4a78-8a1a-2965321d67cb] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:51.669638 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2fcd57d2-6ce7-4f26-88c8-9efcbf69996f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:51.673744 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:51.674207 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:51.674990 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:51.675462 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:51.678523 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2fcd57d2-6ce7-4f26-88c8-9efcbf69996f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.157250 Jul 15 16:03:51.684777 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 558/1112] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:51 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:51.693383 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] HTTP exception thrown: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Request method failure captured: Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb HTTP/1.1 Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y15rT1TIsyB6A89MFOty6Zakg8zgEnifp-iXDBQP0iccrXigikyz1BLgJ2WGC555CIHZmLHzHcWOokfrgFvW1D-OdIo1YZYQ175lSNj5WlEZbie2rY0l87a0y-v2XAwpddEHIWhfBm4yGvgQ_MtSCk53noXhDd_HBMh7Xw27e7yldk Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:03:51.694944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: ac8dfa5c97594e74a6839d91b292adcd Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.696806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': 'f6551bf2-1fcd-4a78-8a1a-2965321d67cb'} Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:51.697601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. Jul 15 16:03:51.698791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:51.699966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Returning 404 to user: Instance f6551bf2-1fcd-4a78-8a1a-2965321d67cb could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:51.699966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-25d84044-e664-4003-ae86-5eaab47072d2 tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb" status: 404 len: 111 microversion: 2.20 time: 0.033569 Jul 15 16:03:51.699966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 555/1113] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:03:51 2022] GET /compute/v2.1/servers/f6551bf2-1fcd-4a78-8a1a-2965321d67cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 15 16:03:52.697413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-449ce25e-8760-46ab-ad15-dac9aa861886 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:52.698020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-449ce25e-8760-46ab-ad15-dac9aa861886 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:52.705390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-449ce25e-8760-46ab-ad15-dac9aa861886 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:52.705842 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-449ce25e-8760-46ab-ad15-dac9aa861886 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:52.706613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-449ce25e-8760-46ab-ad15-dac9aa861886 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:52.707051 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-449ce25e-8760-46ab-ad15-dac9aa861886 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:52.840384 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-449ce25e-8760-46ab-ad15-dac9aa861886 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:52.848079 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-449ce25e-8760-46ab-ad15-dac9aa861886 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.155372 Jul 15 16:03:52.848648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 559/1114] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:52 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:53.174341 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:53.174902 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:53.182713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:53.183605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:53.184578 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:53.185021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] HTTP exception thrown: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Request method failure captured: Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: DELETE /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 HTTP/1.1 Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y15rT1TIsyB6A89MFOty6Zakg8zgEnifp-iXDBQP0iccrXigikyz1BLgJ2WGC555CIHZmLHzHcWOokfrgFvW1D-OdIo1YZYQ175lSNj5WlEZbie2rY0l87a0y-v2XAwpddEHIWhfBm4yGvgQ_MtSCk53noXhDd_HBMh7Xw27e7yldk Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:03:53.213639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: ac8dfa5c97594e74a6839d91b292adcd Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.215803 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '652ce721-72c7-4314-8f15-bf94f30df443'} Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:53.216681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.220300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.222261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Returning 404 to user: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:53.222261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-be4c8648-ecea-449a-a698-ca2af9bdd00e tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "DELETE /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 404 len: 111 microversion: 2.20 time: 0.040034 Jul 15 16:03:53.222261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 556/1115] 10.222.0.98 () {60 vars in 1279 bytes} [Fri Jul 15 16:03:53 2022] DELETE /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 16:03:53.222525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:53.222525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] [instance: 652ce721-72c7-4314-8f15-bf94f30df443] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:53.222525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:53.225250 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:53.225702 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:53.226475 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:53.226913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:53.240347 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] HTTP exception thrown: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Request method failure captured: Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 HTTP/1.1 Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y15rT1TIsyB6A89MFOty6Zakg8zgEnifp-iXDBQP0iccrXigikyz1BLgJ2WGC555CIHZmLHzHcWOokfrgFvW1D-OdIo1YZYQ175lSNj5WlEZbie2rY0l87a0y-v2XAwpddEHIWhfBm4yGvgQ_MtSCk53noXhDd_HBMh7Xw27e7yldk Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:03:53.242004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7df1ad577ddf4dc8a9a75ad1a1337ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 7df1ad577ddf4dc8a9a75ad1a1337ffe Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211949845 Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: ac8dfa5c97594e74a6839d91b292adcd Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211949845-project Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.243859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '652ce721-72c7-4314-8f15-bf94f30df443'} Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:03:53.245045 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. Jul 15 16:03:53.246585 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:03:53.247917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] Returning 404 to user: Instance 652ce721-72c7-4314-8f15-bf94f30df443 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:03:53.247917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-81937be7-2636-40c9-8051-1552eb45cd0f tempest-AttachVolumeShelveTestJSON-211949845 tempest-AttachVolumeShelveTestJSON-211949845-project] 10.222.0.98 "GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443" status: 404 len: 111 microversion: 2.20 time: 0.029732 Jul 15 16:03:53.247917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 560/1116] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Jul 15 16:03:53 2022] GET /compute/v2.1/servers/652ce721-72c7-4314-8f15-bf94f30df443 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 15 16:03:53.865503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8517905f-f53a-4097-ae89-a210850b60c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:53.866123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8517905f-f53a-4097-ae89-a210850b60c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:53.872889 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8517905f-f53a-4097-ae89-a210850b60c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:53.873412 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8517905f-f53a-4097-ae89-a210850b60c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:53.874191 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8517905f-f53a-4097-ae89-a210850b60c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:53.874722 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8517905f-f53a-4097-ae89-a210850b60c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:54.085484 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8517905f-f53a-4097-ae89-a210850b60c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:54.093745 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8517905f-f53a-4097-ae89-a210850b60c0 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.232146 Jul 15 16:03:54.094672 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 557/1117] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:53 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:55.111103 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-42934c17-dd4b-4324-949f-1944ff89a6e1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:55.111775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-42934c17-dd4b-4324-949f-1944ff89a6e1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:55.113582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=8 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:55.119482 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42934c17-dd4b-4324-949f-1944ff89a6e1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:55.119993 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42934c17-dd4b-4324-949f-1944ff89a6e1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:55.120692 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42934c17-dd4b-4324-949f-1944ff89a6e1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:55.121124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-42934c17-dd4b-4324-949f-1944ff89a6e1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:55.273344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-42934c17-dd4b-4324-949f-1944ff89a6e1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:55.286785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-42934c17-dd4b-4324-949f-1944ff89a6e1 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.179528 Jul 15 16:03:55.287867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 561/1118] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:55 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:55.472716 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-3243168c-df50-4826-bef9-43a25761bb31 req-ac30ed3b-994d-4c5e-87ab-856f34bba4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457", "name": "network-vif-plugged", "status": "completed", "tag": "12137d07-ce46-4b7b-aa5b-b78b14eede08"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:03:55.482883 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-3243168c-df50-4826-bef9-43a25761bb31 req-ac30ed3b-994d-4c5e-87ab-856f34bba4f0 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:55.483659 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-3243168c-df50-4826-bef9-43a25761bb31 req-ac30ed3b-994d-4c5e-87ab-856f34bba4f0 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:55.496378 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-3243168c-df50-4826-bef9-43a25761bb31 req-ac30ed3b-994d-4c5e-87ab-856f34bba4f0 service nova] Creating event network-vif-plugged:12137d07-ce46-4b7b-aa5b-b78b14eede08 for instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 on hv-cinder-83587 Jul 15 16:03:55.501490 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-3243168c-df50-4826-bef9-43a25761bb31 req-ac30ed3b-994d-4c5e-87ab-856f34bba4f0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033063 Jul 15 16:03:55.506343 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 558/1119] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:03:56.307657 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-749d45c9-8c2c-4177-9128-4f1dc63dcfdb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:56.308203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-749d45c9-8c2c-4177-9128-4f1dc63dcfdb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:56.315048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-749d45c9-8c2c-4177-9128-4f1dc63dcfdb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:56.318036 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-749d45c9-8c2c-4177-9128-4f1dc63dcfdb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:56.318036 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-749d45c9-8c2c-4177-9128-4f1dc63dcfdb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:56.318036 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-749d45c9-8c2c-4177-9128-4f1dc63dcfdb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:56.466083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-749d45c9-8c2c-4177-9128-4f1dc63dcfdb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:56.473742 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-749d45c9-8c2c-4177-9128-4f1dc63dcfdb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.170594 Jul 15 16:03:56.474305 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 562/1120] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:56 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:57.491070 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-6a6207cc-12ef-4ee0-8b21-3f32df2a2ace tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:57.491806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-6a6207cc-12ef-4ee0-8b21-3f32df2a2ace tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:57.494261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:03:57.499143 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6a6207cc-12ef-4ee0-8b21-3f32df2a2ace tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:57.499620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6a6207cc-12ef-4ee0-8b21-3f32df2a2ace tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:57.500377 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6a6207cc-12ef-4ee0-8b21-3f32df2a2ace tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:57.500807 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-6a6207cc-12ef-4ee0-8b21-3f32df2a2ace tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:57.658040 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-6a6207cc-12ef-4ee0-8b21-3f32df2a2ace tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:57.666456 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-6a6207cc-12ef-4ee0-8b21-3f32df2a2ace tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1366 microversion: 2.1 time: 0.180079 Jul 15 16:03:57.667038 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 559/1121] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:57 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:58.683427 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-68838947-9534-46bc-bf7f-b237a586f788 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:58.684124 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-68838947-9534-46bc-bf7f-b237a586f788 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:58.690733 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68838947-9534-46bc-bf7f-b237a586f788 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:58.691247 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68838947-9534-46bc-bf7f-b237a586f788 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:58.692114 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68838947-9534-46bc-bf7f-b237a586f788 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:58.692559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68838947-9534-46bc-bf7f-b237a586f788 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:58.832439 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-68838947-9534-46bc-bf7f-b237a586f788 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:03:58.842189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-68838947-9534-46bc-bf7f-b237a586f788 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1554 microversion: 2.1 time: 0.162868 Jul 15 16:03:58.842756 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 563/1122] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:03:58 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:03:58.858500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-20fdbf27-55e7-4155-8edb-e6c498a3facc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:03:58.859043 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-20fdbf27-55e7-4155-8edb-e6c498a3facc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:03:58.866364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20fdbf27-55e7-4155-8edb-e6c498a3facc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:58.866816 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20fdbf27-55e7-4155-8edb-e6c498a3facc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:58.867623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20fdbf27-55e7-4155-8edb-e6c498a3facc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:03:58.868062 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-20fdbf27-55e7-4155-8edb-e6c498a3facc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:03:58.946019 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-20fdbf27-55e7-4155-8edb-e6c498a3facc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091498 Jul 15 16:03:58.953169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 560/1123] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Jul 15 16:03:58 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:04:00.057036 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-81dde4e1-2802-45db-ba94-3c715d37a735 req-12459218-728c-41dc-97db-bca1599d6748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457", "tag": "12137d07-ce46-4b7b-aa5b-b78b14eede08"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:04:00.070522 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-81dde4e1-2802-45db-ba94-3c715d37a735 req-12459218-728c-41dc-97db-bca1599d6748 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:00.071869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-81dde4e1-2802-45db-ba94-3c715d37a735 req-12459218-728c-41dc-97db-bca1599d6748 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:00.088055 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-81dde4e1-2802-45db-ba94-3c715d37a735 req-12459218-728c-41dc-97db-bca1599d6748 service nova] Creating event network-changed:12137d07-ce46-4b7b-aa5b-b78b14eede08 for instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 on hv-cinder-83587 Jul 15 16:04:00.094445 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-81dde4e1-2802-45db-ba94-3c715d37a735 req-12459218-728c-41dc-97db-bca1599d6748 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041330 Jul 15 16:04:00.095567 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 564/1124] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:04:20.106753 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=70 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:04:20.111198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e5eb5707-f63b-441a-bbcc-a12cdd1b38b1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:20.111723 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e5eb5707-f63b-441a-bbcc-a12cdd1b38b1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:20.119401 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5eb5707-f63b-441a-bbcc-a12cdd1b38b1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:20.120145 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5eb5707-f63b-441a-bbcc-a12cdd1b38b1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:20.121148 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5eb5707-f63b-441a-bbcc-a12cdd1b38b1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:20.121903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5eb5707-f63b-441a-bbcc-a12cdd1b38b1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:20.211969 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-e5eb5707-f63b-441a-bbcc-a12cdd1b38b1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lazy-loading 'services' on Instance uuid 65288e88-4533-4139-9d66-f83c022d57db {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:04:20.542623 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e5eb5707-f63b-441a-bbcc-a12cdd1b38b1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "DELETE /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db/os-volume_attachments/21dc8889-1232-44c5-930b-98c902b1967b" status: 202 len: 0 microversion: 2.1 time: 0.436993 Jul 15 16:04:20.543220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 561/1125] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:04:20 2022] DELETE /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db/os-volume_attachments/21dc8889-1232-44c5-930b-98c902b1967b => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:04:21.772155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:04:21.772898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=30 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:04:21.776895 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6e545b6b-5539-46e3-accf-6b551e7d624e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:21.777556 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6e545b6b-5539-46e3-accf-6b551e7d624e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:21.783804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e545b6b-5539-46e3-accf-6b551e7d624e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:21.784257 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e545b6b-5539-46e3-accf-6b551e7d624e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:21.785065 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e545b6b-5539-46e3-accf-6b551e7d624e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:21.785500 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6e545b6b-5539-46e3-accf-6b551e7d624e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:21.821350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6e545b6b-5539-46e3-accf-6b551e7d624e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:04:22.137937 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6e545b6b-5539-46e3-accf-6b551e7d624e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "DELETE /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 204 len: 0 microversion: 2.1 time: 0.367019 Jul 15 16:04:22.138631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 565/1126] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:04:21 2022] DELETE /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:04:22.147241 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-81219a2c-3ec4-4dc0-a062-2dc11a1bdecd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:22.148021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-81219a2c-3ec4-4dc0-a062-2dc11a1bdecd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:22.155757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-81219a2c-3ec4-4dc0-a062-2dc11a1bdecd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:22.156215 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-81219a2c-3ec4-4dc0-a062-2dc11a1bdecd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:22.157039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-81219a2c-3ec4-4dc0-a062-2dc11a1bdecd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:22.157482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-81219a2c-3ec4-4dc0-a062-2dc11a1bdecd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:22.289031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-81219a2c-3ec4-4dc0-a062-2dc11a1bdecd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:22.296581 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-81219a2c-3ec4-4dc0-a062-2dc11a1bdecd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1511 microversion: 2.1 time: 0.153550 Jul 15 16:04:22.298001 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 562/1127] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:22 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:23.314066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2e1cfd0d-3488-45ea-af14-3f5dd6380fa2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:23.314778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2e1cfd0d-3488-45ea-af14-3f5dd6380fa2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:23.321239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2e1cfd0d-3488-45ea-af14-3f5dd6380fa2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:23.321876 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2e1cfd0d-3488-45ea-af14-3f5dd6380fa2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:23.322489 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2e1cfd0d-3488-45ea-af14-3f5dd6380fa2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:23.322936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2e1cfd0d-3488-45ea-af14-3f5dd6380fa2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:23.464874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2e1cfd0d-3488-45ea-af14-3f5dd6380fa2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:23.472607 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2e1cfd0d-3488-45ea-af14-3f5dd6380fa2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1511 microversion: 2.1 time: 0.162769 Jul 15 16:04:23.473184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 566/1128] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:23 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:24.490254 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-08fcb2f5-d7b9-4ca8-96a2-f4c1bae108f9 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:24.491216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-08fcb2f5-d7b9-4ca8-96a2-f4c1bae108f9 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:24.497982 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-08fcb2f5-d7b9-4ca8-96a2-f4c1bae108f9 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:24.498436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-08fcb2f5-d7b9-4ca8-96a2-f4c1bae108f9 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:24.499211 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-08fcb2f5-d7b9-4ca8-96a2-f4c1bae108f9 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:24.499676 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-08fcb2f5-d7b9-4ca8-96a2-f4c1bae108f9 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:24.984878 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-08fcb2f5-d7b9-4ca8-96a2-f4c1bae108f9 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:24.992592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-08fcb2f5-d7b9-4ca8-96a2-f4c1bae108f9 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1511 microversion: 2.1 time: 0.506242 Jul 15 16:04:24.993162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 563/1129] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:24 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:25.157879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-ca3cb073-15f7-43a0-a10a-390a4a0dfe4f req-dafa03ad-fe66-449d-90ba-1046a3981df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65288e88-4533-4139-9d66-f83c022d57db", "name": "network-vif-deleted", "tag": "e1246a30-532b-4be5-9b1f-e60c689fa115"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:04:25.166505 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-ca3cb073-15f7-43a0-a10a-390a4a0dfe4f req-dafa03ad-fe66-449d-90ba-1046a3981df7 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:25.181936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-ca3cb073-15f7-43a0-a10a-390a4a0dfe4f req-dafa03ad-fe66-449d-90ba-1046a3981df7 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:25.181936 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-ca3cb073-15f7-43a0-a10a-390a4a0dfe4f req-dafa03ad-fe66-449d-90ba-1046a3981df7 service nova] Creating event network-vif-deleted:e1246a30-532b-4be5-9b1f-e60c689fa115 for instance 65288e88-4533-4139-9d66-f83c022d57db on hv-cinder-83587 Jul 15 16:04:25.182776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-ca3cb073-15f7-43a0-a10a-390a4a0dfe4f req-dafa03ad-fe66-449d-90ba-1046a3981df7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028685 Jul 15 16:04:25.183582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 567/1130] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:04:26.010102 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-df3d3afa-24c0-48e3-aa00-273cc751c6e7 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:26.010785 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-df3d3afa-24c0-48e3-aa00-273cc751c6e7 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:26.033589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df3d3afa-24c0-48e3-aa00-273cc751c6e7 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:26.033589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df3d3afa-24c0-48e3-aa00-273cc751c6e7 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:26.033589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df3d3afa-24c0-48e3-aa00-273cc751c6e7 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:26.033589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-df3d3afa-24c0-48e3-aa00-273cc751c6e7 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:26.085078 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-df3d3afa-24c0-48e3-aa00-273cc751c6e7 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:26.090249 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-df3d3afa-24c0-48e3-aa00-273cc751c6e7 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1302 microversion: 2.1 time: 0.084572 Jul 15 16:04:26.090812 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 564/1131] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:26 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:27.107925 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-43b11d31-0620-46f3-a1a6-e580897863d2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:27.108634 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-43b11d31-0620-46f3-a1a6-e580897863d2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:27.118834 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-43b11d31-0620-46f3-a1a6-e580897863d2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:27.120200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-43b11d31-0620-46f3-a1a6-e580897863d2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:27.121590 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-43b11d31-0620-46f3-a1a6-e580897863d2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:27.122394 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-43b11d31-0620-46f3-a1a6-e580897863d2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:27.195513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-43b11d31-0620-46f3-a1a6-e580897863d2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:27.203623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-43b11d31-0620-46f3-a1a6-e580897863d2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1302 microversion: 2.1 time: 0.100045 Jul 15 16:04:27.204196 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 568/1132] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:27 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1302 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:28.220693 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-cb9609d8-51d5-427e-bb22-704a8ec42cc1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:28.221348 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-cb9609d8-51d5-427e-bb22-704a8ec42cc1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:28.228021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb9609d8-51d5-427e-bb22-704a8ec42cc1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:28.228476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb9609d8-51d5-427e-bb22-704a8ec42cc1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:28.229255 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb9609d8-51d5-427e-bb22-704a8ec42cc1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:28.229713 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-cb9609d8-51d5-427e-bb22-704a8ec42cc1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:28.292996 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-cb9609d8-51d5-427e-bb22-704a8ec42cc1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:28.300506 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-cb9609d8-51d5-427e-bb22-704a8ec42cc1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1302 microversion: 2.1 time: 0.083738 Jul 15 16:04:28.301071 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 565/1133] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:28 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:29.316762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:29.317379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:29.323912 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:29.324365 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:29.325134 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:29.325571 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:29.358551 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:29.359018 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:29.359504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lazy-loading 'fault' on Instance uuid 65288e88-4533-4139-9d66-f83c022d57db {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:04:29.402795 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:29.411484 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-97d46bde-dc7b-476d-83b7-bf32ae4fbe51 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 200 len: 1307 microversion: 2.1 time: 0.098414 Jul 15 16:04:29.412235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 569/1134] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:29 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:30.434138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:30.436847 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: 65288e88-4533-4139-9d66-f83c022d57db] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:30.441260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:30.441706 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:30.442465 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:30.442897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:30.456604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] HTTP exception thrown: Instance 65288e88-4533-4139-9d66-f83c022d57db could not be found. Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Request method failure captured: Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db HTTP/1.1 Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y-0AKLUeAuTI4VPeRzf3bxN34orLgIlz1G3s7VZH-RnN67NTGTxNoZ-Ay3fcLEmGqyeI-AoqX7STcsUCDbTJKQcx-Q09r8qtP8BkbPlcc3HsxH3BMdp8aeyqlPev-xCa5sI9WIRc-_fOmr7o915qiP2_3gcGDwAmA51BaZlSXHkAKY Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 836bc4ea37f841cf9704999d88a627c4 Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-VolumesSnapshotTestJSON-96866579 Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:04:30.458369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/836bc4ea37f841cf9704999d88a627c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_836bc4ea37f841cf9704999d88a627c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/836bc4ea37f841cf9704999d88a627c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/836bc4ea37f841cf9704999d88a627c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-VolumesSnapshotTestJSON-96866579 Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 836bc4ea37f841cf9704999d88a627c4 Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-96866579 Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-VolumesSnapshotTestJSON-96866579-project Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: cd49fd5c3cd5463b88efa5937d88cea0 Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-VolumesSnapshotTestJSON-96866579-project Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 65288e88-4533-4139-9d66-f83c022d57db could not be found. Jul 15 16:04:30.460140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '65288e88-4533-4139-9d66-f83c022d57db'} Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65288e88-4533-4139-9d66-f83c022d57db could not be found. Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:04:30.461213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65288e88-4533-4139-9d66-f83c022d57db could not be found. Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65288e88-4533-4139-9d66-f83c022d57db could not be found. Jul 15 16:04:30.465344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:04:30.466543 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Returning 404 to user: Instance 65288e88-4533-4139-9d66-f83c022d57db could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:04:30.466543 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-67869f09-0818-43f1-a680-a450ddf29f90 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db" status: 404 len: 111 microversion: 2.1 time: 0.029619 Jul 15 16:04:30.466543 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 566/1135] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:30 2022] GET /compute/v2.1/servers/65288e88-4533-4139-9d66-f83c022d57db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:04:50.152326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1728091322", "imageRef": "25cd7754-162f-4254-a5b8-748ce146bc90", "flavorRef": "452", "networks": [{"uuid": "83d2fdc3-c6fb-4201-b803-31249831a8e8"}]}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:04:50.159825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:04:50.160687 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:04:50.205863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] validate_networks() for [('83d2fdc3-c6fb-4201-b803-31249831a8e8', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:04:50.559151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:04:50.559611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:04:50.560093 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:04:50.560525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:04:50.560929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:04:50.570655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:50.571111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:50.571978 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:50.572420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:50.594083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Getting quotas for project 836bc4ea37f841cf9704999d88a627c4. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:04:50.601330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Getting quotas for user cd49fd5c3cd5463b88efa5937d88cea0 and project 836bc4ea37f841cf9704999d88a627c4. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:04:50.609890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:04:50.612200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cd7754-162f-4254-a5b8-748ce146bc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:04:50.800728 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-edee01ba-33e1-4c6e-8dd5-78f75efb95c2 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652725 Jul 15 16:04:50.801369 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 570/1136] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 16:04:50.812093 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9987c1f9-e691-4071-a9af-f0d14d48af74 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:50.812714 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9987c1f9-e691-4071-a9af-f0d14d48af74 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:50.815059 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=15 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:04:50.815787 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:04:50.874324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9987c1f9-e691-4071-a9af-f0d14d48af74 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:50.882184 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9987c1f9-e691-4071-a9af-f0d14d48af74 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1219 microversion: 2.1 time: 0.074462 Jul 15 16:04:50.884364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 567/1137] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:50 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:51.901135 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dc725d3f-658a-4f93-bdb8-f178111420fd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:51.905816 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dc725d3f-658a-4f93-bdb8-f178111420fd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:51.908396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dc725d3f-658a-4f93-bdb8-f178111420fd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:51.909140 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dc725d3f-658a-4f93-bdb8-f178111420fd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:51.910436 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dc725d3f-658a-4f93-bdb8-f178111420fd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:51.911083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dc725d3f-658a-4f93-bdb8-f178111420fd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:51.977319 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-dc725d3f-658a-4f93-bdb8-f178111420fd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:51.985622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dc725d3f-658a-4f93-bdb8-f178111420fd tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1223 microversion: 2.1 time: 0.088946 Jul 15 16:04:51.986238 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 571/1138] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:51 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:53.005119 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-57e98884-cb48-4460-8ff7-8b682d2911c1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:53.006279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-57e98884-cb48-4460-8ff7-8b682d2911c1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:53.015741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-57e98884-cb48-4460-8ff7-8b682d2911c1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:53.016197 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-57e98884-cb48-4460-8ff7-8b682d2911c1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:53.016976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-57e98884-cb48-4460-8ff7-8b682d2911c1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:53.017424 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-57e98884-cb48-4460-8ff7-8b682d2911c1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:53.082232 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-57e98884-cb48-4460-8ff7-8b682d2911c1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:53.090172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-57e98884-cb48-4460-8ff7-8b682d2911c1 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1223 microversion: 2.1 time: 0.090358 Jul 15 16:04:53.090763 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 568/1139] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:52 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:54.106853 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ba6eb9e1-cd61-4fec-b676-4ae865436043 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:54.107518 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ba6eb9e1-cd61-4fec-b676-4ae865436043 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:54.114327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ba6eb9e1-cd61-4fec-b676-4ae865436043 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:54.114781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ba6eb9e1-cd61-4fec-b676-4ae865436043 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:54.115714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ba6eb9e1-cd61-4fec-b676-4ae865436043 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:54.116158 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ba6eb9e1-cd61-4fec-b676-4ae865436043 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:54.178019 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ba6eb9e1-cd61-4fec-b676-4ae865436043 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:54.185342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ba6eb9e1-cd61-4fec-b676-4ae865436043 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1223 microversion: 2.1 time: 0.082654 Jul 15 16:04:54.192881 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 572/1140] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:54 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:55.202140 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bcd21394-138e-44f5-9e03-0f127fe81b42 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:55.202690 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bcd21394-138e-44f5-9e03-0f127fe81b42 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:55.209818 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bcd21394-138e-44f5-9e03-0f127fe81b42 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:55.210266 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bcd21394-138e-44f5-9e03-0f127fe81b42 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:55.211034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bcd21394-138e-44f5-9e03-0f127fe81b42 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:55.211503 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bcd21394-138e-44f5-9e03-0f127fe81b42 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:55.273088 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bcd21394-138e-44f5-9e03-0f127fe81b42 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:55.280957 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bcd21394-138e-44f5-9e03-0f127fe81b42 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1271 microversion: 2.1 time: 0.082882 Jul 15 16:04:55.281523 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 569/1141] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:55 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:56.298598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4858bef2-4891-41b0-a77c-87e58e6bfc7e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:56.300775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4858bef2-4891-41b0-a77c-87e58e6bfc7e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:56.308025 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4858bef2-4891-41b0-a77c-87e58e6bfc7e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:56.308738 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4858bef2-4891-41b0-a77c-87e58e6bfc7e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:56.311084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4858bef2-4891-41b0-a77c-87e58e6bfc7e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:56.311570 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4858bef2-4891-41b0-a77c-87e58e6bfc7e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:56.448967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4858bef2-4891-41b0-a77c-87e58e6bfc7e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:56.456392 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4858bef2-4891-41b0-a77c-87e58e6bfc7e tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.161940 Jul 15 16:04:56.456964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 573/1142] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:56 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:57.474041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-7a961ef0-2995-4f6d-9a7f-750c85858fa6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:57.474751 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-7a961ef0-2995-4f6d-9a7f-750c85858fa6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:57.481540 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7a961ef0-2995-4f6d-9a7f-750c85858fa6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:57.482156 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7a961ef0-2995-4f6d-9a7f-750c85858fa6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:57.485195 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7a961ef0-2995-4f6d-9a7f-750c85858fa6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:57.485648 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-7a961ef0-2995-4f6d-9a7f-750c85858fa6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:57.550253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-5c3aa455-2590-4a61-8ced-aa490adbfe73 req-c53488ae-52de-414e-ad6f-12005c09a2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8af5900-5251-4759-8aa6-7baffad6074a", "tag": "5c780e1d-203d-43ad-8873-c0be2573711a"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:04:57.562476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-5c3aa455-2590-4a61-8ced-aa490adbfe73 req-c53488ae-52de-414e-ad6f-12005c09a2c5 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:57.564474 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-5c3aa455-2590-4a61-8ced-aa490adbfe73 req-c53488ae-52de-414e-ad6f-12005c09a2c5 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:57.578357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-5c3aa455-2590-4a61-8ced-aa490adbfe73 req-c53488ae-52de-414e-ad6f-12005c09a2c5 service nova] Creating event network-changed:5c780e1d-203d-43ad-8873-c0be2573711a for instance d8af5900-5251-4759-8aa6-7baffad6074a on hv-cinder-83587 Jul 15 16:04:57.588288 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-5c3aa455-2590-4a61-8ced-aa490adbfe73 req-c53488ae-52de-414e-ad6f-12005c09a2c5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227197 Jul 15 16:04:57.588288 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 570/1143] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:04:57.638164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-7a961ef0-2995-4f6d-9a7f-750c85858fa6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:57.645877 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-7a961ef0-2995-4f6d-9a7f-750c85858fa6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.175640 Jul 15 16:04:57.655200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 574/1144] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:57 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:58.662977 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3bf71cba-5431-40af-b928-36e6c01252b4 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:58.663925 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3bf71cba-5431-40af-b928-36e6c01252b4 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:58.671005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3bf71cba-5431-40af-b928-36e6c01252b4 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:58.671499 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3bf71cba-5431-40af-b928-36e6c01252b4 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:58.672271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3bf71cba-5431-40af-b928-36e6c01252b4 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:58.672710 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3bf71cba-5431-40af-b928-36e6c01252b4 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:58.806122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3bf71cba-5431-40af-b928-36e6c01252b4 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:58.814104 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3bf71cba-5431-40af-b928-36e6c01252b4 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.155512 Jul 15 16:04:58.820345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 571/1145] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:58 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:04:59.831600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-189afd7f-791e-48a2-9ce3-1b6d8f3f7d49 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:04:59.832137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-189afd7f-791e-48a2-9ce3-1b6d8f3f7d49 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:04:59.839131 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-189afd7f-791e-48a2-9ce3-1b6d8f3f7d49 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:59.839680 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-189afd7f-791e-48a2-9ce3-1b6d8f3f7d49 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:59.840707 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-189afd7f-791e-48a2-9ce3-1b6d8f3f7d49 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:04:59.841145 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-189afd7f-791e-48a2-9ce3-1b6d8f3f7d49 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:04:59.973479 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-189afd7f-791e-48a2-9ce3-1b6d8f3f7d49 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:04:59.981649 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-189afd7f-791e-48a2-9ce3-1b6d8f3f7d49 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.154119 Jul 15 16:04:59.982214 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 575/1146] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:04:59 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:00.999084 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-622ab94d-17e5-4079-b598-accbeaebb951 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:01.001987 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-622ab94d-17e5-4079-b598-accbeaebb951 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:01.002178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:05:01.006972 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-622ab94d-17e5-4079-b598-accbeaebb951 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:01.007461 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-622ab94d-17e5-4079-b598-accbeaebb951 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:01.008282 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-622ab94d-17e5-4079-b598-accbeaebb951 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:01.008715 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-622ab94d-17e5-4079-b598-accbeaebb951 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:01.140974 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-622ab94d-17e5-4079-b598-accbeaebb951 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:01.148424 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-622ab94d-17e5-4079-b598-accbeaebb951 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.153830 Jul 15 16:05:01.148989 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 572/1147] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:00 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:02.166939 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1ac14fe8-dd91-4181-b2fb-12579d6aa26c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:02.168701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1ac14fe8-dd91-4181-b2fb-12579d6aa26c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:02.171723 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:05:02.172402 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=6 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:05:02.176841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ac14fe8-dd91-4181-b2fb-12579d6aa26c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:02.177301 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ac14fe8-dd91-4181-b2fb-12579d6aa26c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:02.178087 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ac14fe8-dd91-4181-b2fb-12579d6aa26c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:02.178581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ac14fe8-dd91-4181-b2fb-12579d6aa26c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:02.318456 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1ac14fe8-dd91-4181-b2fb-12579d6aa26c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:02.327790 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1ac14fe8-dd91-4181-b2fb-12579d6aa26c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.164378 Jul 15 16:05:02.328367 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 576/1148] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:02 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:03.345206 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7deeedc8-124f-4b98-8b2b-c8616029d65c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:03.345841 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7deeedc8-124f-4b98-8b2b-c8616029d65c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:03.352313 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7deeedc8-124f-4b98-8b2b-c8616029d65c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:03.352766 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7deeedc8-124f-4b98-8b2b-c8616029d65c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:03.353539 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7deeedc8-124f-4b98-8b2b-c8616029d65c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:03.353980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7deeedc8-124f-4b98-8b2b-c8616029d65c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:03.493323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7deeedc8-124f-4b98-8b2b-c8616029d65c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:03.501165 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7deeedc8-124f-4b98-8b2b-c8616029d65c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.159829 Jul 15 16:05:03.501734 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 573/1149] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:03 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:04.000063 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-7fefbe22-82f2-480e-b632-7b18308c45d0 req-9ad6c2e5-a7b3-4ba5-b240-ca1f90f76c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8af5900-5251-4759-8aa6-7baffad6074a", "name": "network-vif-plugged", "status": "completed", "tag": "5c780e1d-203d-43ad-8873-c0be2573711a"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:05:04.008208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-7fefbe22-82f2-480e-b632-7b18308c45d0 req-9ad6c2e5-a7b3-4ba5-b240-ca1f90f76c08 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:04.008654 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-7fefbe22-82f2-480e-b632-7b18308c45d0 req-9ad6c2e5-a7b3-4ba5-b240-ca1f90f76c08 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:04.020387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-7fefbe22-82f2-480e-b632-7b18308c45d0 req-9ad6c2e5-a7b3-4ba5-b240-ca1f90f76c08 service nova] Creating event network-vif-plugged:5c780e1d-203d-43ad-8873-c0be2573711a for instance d8af5900-5251-4759-8aa6-7baffad6074a on hv-cinder-83587 Jul 15 16:05:04.025185 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-7fefbe22-82f2-480e-b632-7b18308c45d0 req-9ad6c2e5-a7b3-4ba5-b240-ca1f90f76c08 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144711 Jul 15 16:05:04.025771 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 577/1150] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:05:04.517688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4db50ee9-77ae-4017-8ab4-f14b0356dffe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:04.518326 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4db50ee9-77ae-4017-8ab4-f14b0356dffe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:04.524778 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4db50ee9-77ae-4017-8ab4-f14b0356dffe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:04.525244 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4db50ee9-77ae-4017-8ab4-f14b0356dffe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:04.526036 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4db50ee9-77ae-4017-8ab4-f14b0356dffe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:04.526476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4db50ee9-77ae-4017-8ab4-f14b0356dffe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:04.677920 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4db50ee9-77ae-4017-8ab4-f14b0356dffe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:04.686002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4db50ee9-77ae-4017-8ab4-f14b0356dffe tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.172146 Jul 15 16:05:04.686576 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 574/1151] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:04 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:05.705122 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-68b15199-6c6f-46ec-bff5-56c90c337693 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:05.705730 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-68b15199-6c6f-46ec-bff5-56c90c337693 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:05.712026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68b15199-6c6f-46ec-bff5-56c90c337693 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:05.712473 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68b15199-6c6f-46ec-bff5-56c90c337693 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:05.713235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68b15199-6c6f-46ec-bff5-56c90c337693 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:05.713668 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-68b15199-6c6f-46ec-bff5-56c90c337693 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:05.839818 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-68b15199-6c6f-46ec-bff5-56c90c337693 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:05.847490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-68b15199-6c6f-46ec-bff5-56c90c337693 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1319 microversion: 2.1 time: 0.147118 Jul 15 16:05:05.848053 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 578/1152] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:05 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:05:06.864706 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-191564c4-1182-4b4b-b837-4603e33eaab6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:06.865325 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-191564c4-1182-4b4b-b837-4603e33eaab6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:06.872782 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-191564c4-1182-4b4b-b837-4603e33eaab6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:06.873237 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-191564c4-1182-4b4b-b837-4603e33eaab6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:06.874009 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-191564c4-1182-4b4b-b837-4603e33eaab6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:06.874453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-191564c4-1182-4b4b-b837-4603e33eaab6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:07.002364 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-191564c4-1182-4b4b-b837-4603e33eaab6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:07.009904 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-191564c4-1182-4b4b-b837-4603e33eaab6 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1508 microversion: 2.1 time: 0.149184 Jul 15 16:05:07.010539 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 575/1153] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:06 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:07.026480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-039dd143-f1ae-41a2-b94f-3192211dcd2c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2abf5a75-a6b7-4a67-be41-cfe2e6e60dd4", "device": "/dev/sdb"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:05:07.027679 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-039dd143-f1ae-41a2-b94f-3192211dcd2c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:07.034161 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-039dd143-f1ae-41a2-b94f-3192211dcd2c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:07.034615 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-039dd143-f1ae-41a2-b94f-3192211dcd2c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:07.035411 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-039dd143-f1ae-41a2-b94f-3192211dcd2c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:07.035852 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-039dd143-f1ae-41a2-b94f-3192211dcd2c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:07.726121 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-039dd143-f1ae-41a2-b94f-3192211dcd2c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "POST /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703593 Jul 15 16:05:07.726734 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 579/1154] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 16:05:07 2022] POST /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:05:36.292712 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4f98e79e-397d-465d-a1b9-725eb8b9328c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:36.293263 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4f98e79e-397d-465d-a1b9-725eb8b9328c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:36.295477 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=20 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:05:36.304948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=44 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:05:36.304948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4f98e79e-397d-465d-a1b9-725eb8b9328c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:36.304948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4f98e79e-397d-465d-a1b9-725eb8b9328c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:36.304948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4f98e79e-397d-465d-a1b9-725eb8b9328c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:36.305354 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4f98e79e-397d-465d-a1b9-725eb8b9328c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:36.385727 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-4f98e79e-397d-465d-a1b9-725eb8b9328c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lazy-loading 'services' on Instance uuid d8af5900-5251-4759-8aa6-7baffad6074a {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:05:36.619210 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4f98e79e-397d-465d-a1b9-725eb8b9328c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a/os-volume_attachments/2abf5a75-a6b7-4a67-be41-cfe2e6e60dd4" status: 202 len: 0 microversion: 2.1 time: 0.330287 Jul 15 16:05:36.619824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 576/1155] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:05:36 2022] DELETE /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a/os-volume_attachments/2abf5a75-a6b7-4a67-be41-cfe2e6e60dd4 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:05:38.783792 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:05:38.784573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:05:38.788573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1e460a25-6e7a-4d17-aaf3-861f6f9f675c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:38.792992 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1e460a25-6e7a-4d17-aaf3-861f6f9f675c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:38.795492 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1e460a25-6e7a-4d17-aaf3-861f6f9f675c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:38.795952 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1e460a25-6e7a-4d17-aaf3-861f6f9f675c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:38.796711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1e460a25-6e7a-4d17-aaf3-861f6f9f675c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:38.797147 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1e460a25-6e7a-4d17-aaf3-861f6f9f675c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:38.823082 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1e460a25-6e7a-4d17-aaf3-861f6f9f675c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:05:39.328462 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1e460a25-6e7a-4d17-aaf3-861f6f9f675c tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 204 len: 0 microversion: 2.1 time: 0.545936 Jul 15 16:05:39.329244 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 580/1156] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:05:38 2022] DELETE /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:05:39.340174 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c3b641e4-4668-4503-b0d4-bb5e7940b044 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:39.340920 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c3b641e4-4668-4503-b0d4-bb5e7940b044 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:39.347699 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c3b641e4-4668-4503-b0d4-bb5e7940b044 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:39.348172 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c3b641e4-4668-4503-b0d4-bb5e7940b044 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:39.349058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c3b641e4-4668-4503-b0d4-bb5e7940b044 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:39.349504 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c3b641e4-4668-4503-b0d4-bb5e7940b044 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:39.491569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c3b641e4-4668-4503-b0d4-bb5e7940b044 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:39.499754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c3b641e4-4668-4503-b0d4-bb5e7940b044 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1514 microversion: 2.1 time: 0.164992 Jul 15 16:05:39.500324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 577/1157] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:39 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:40.517482 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b0194c91-79b5-42ce-bdd1-666d30ff937d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:40.518189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b0194c91-79b5-42ce-bdd1-666d30ff937d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:40.525085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b0194c91-79b5-42ce-bdd1-666d30ff937d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:40.525542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b0194c91-79b5-42ce-bdd1-666d30ff937d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:40.526313 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b0194c91-79b5-42ce-bdd1-666d30ff937d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:40.526757 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b0194c91-79b5-42ce-bdd1-666d30ff937d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:40.662859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b0194c91-79b5-42ce-bdd1-666d30ff937d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:40.671517 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b0194c91-79b5-42ce-bdd1-666d30ff937d tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1514 microversion: 2.1 time: 0.158207 Jul 15 16:05:40.672229 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 581/1158] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:40 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:41.689903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0976b245-eda7-4f2c-8199-e619dc053b27 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:41.690449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0976b245-eda7-4f2c-8199-e619dc053b27 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:41.696936 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0976b245-eda7-4f2c-8199-e619dc053b27 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:41.697419 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0976b245-eda7-4f2c-8199-e619dc053b27 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:41.698198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0976b245-eda7-4f2c-8199-e619dc053b27 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:41.698695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0976b245-eda7-4f2c-8199-e619dc053b27 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:41.924106 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0976b245-eda7-4f2c-8199-e619dc053b27 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:41.931938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0976b245-eda7-4f2c-8199-e619dc053b27 tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1514 microversion: 2.1 time: 0.245998 Jul 15 16:05:41.932835 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 578/1159] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:41 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:42.388468 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-18d2e346-7f4c-4363-9bf1-785938ca588b req-e27f52fc-a0b9-4d40-91ce-136f1368acfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8af5900-5251-4759-8aa6-7baffad6074a", "name": "network-vif-deleted", "tag": "5c780e1d-203d-43ad-8873-c0be2573711a"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:05:42.396863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-18d2e346-7f4c-4363-9bf1-785938ca588b req-e27f52fc-a0b9-4d40-91ce-136f1368acfe service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:42.401652 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-18d2e346-7f4c-4363-9bf1-785938ca588b req-e27f52fc-a0b9-4d40-91ce-136f1368acfe service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:42.408924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-18d2e346-7f4c-4363-9bf1-785938ca588b req-e27f52fc-a0b9-4d40-91ce-136f1368acfe service nova] Creating event network-vif-deleted:5c780e1d-203d-43ad-8873-c0be2573711a for instance d8af5900-5251-4759-8aa6-7baffad6074a on hv-cinder-83587 Jul 15 16:05:42.415305 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-18d2e346-7f4c-4363-9bf1-785938ca588b req-e27f52fc-a0b9-4d40-91ce-136f1368acfe service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Jul 15 16:05:42.415935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 582/1160] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:05:42.950039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:42.950639 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:42.957137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:42.957591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:42.958358 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:42.958792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:42.992386 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:42.992830 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:42.993274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lazy-loading 'fault' on Instance uuid d8af5900-5251-4759-8aa6-7baffad6074a {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:05:43.035525 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd49fd5c3cd5463b88efa5937d88cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836bc4ea37f841cf9704999d88a627c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:05:43.043318 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-681b19e9-0dd7-4059-8b71-d71c712a03fa tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 200 len: 1309 microversion: 2.1 time: 0.097570 Jul 15 16:05:43.043912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 579/1161] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:42 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:05:44.062896 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:05:44.063561 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] [instance: d8af5900-5251-4759-8aa6-7baffad6074a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:05:44.069966 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:44.070438 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:44.071249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:05:44.071721 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:05:44.086081 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] HTTP exception thrown: Instance d8af5900-5251-4759-8aa6-7baffad6074a could not be found. Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Request method failure captured: Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a HTTP/1.1 Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y-0AKLUeAuTI4VPeRzf3bxN34orLgIlz1G3s7VZH-RnN67NTGTxNoZ-Ay3fcLEmGqyeI-AoqX7STcsUCDbTJKQcx-Q09r8qtP8BkbPlcc3HsxH3BMdp8aeyqlPev-xCa5sI9WIRc-_fOmr7o915qiP2_3gcGDwAmA51BaZlSXHkAKY Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 836bc4ea37f841cf9704999d88a627c4 Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-VolumesSnapshotTestJSON-96866579 Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:05:44.087837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/836bc4ea37f841cf9704999d88a627c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_836bc4ea37f841cf9704999d88a627c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/836bc4ea37f841cf9704999d88a627c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/836bc4ea37f841cf9704999d88a627c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-VolumesSnapshotTestJSON-96866579 Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 836bc4ea37f841cf9704999d88a627c4 Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-96866579 Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-VolumesSnapshotTestJSON-96866579-project Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: cd49fd5c3cd5463b88efa5937d88cea0 Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-VolumesSnapshotTestJSON-96866579-project Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance d8af5900-5251-4759-8aa6-7baffad6074a could not be found. Jul 15 16:05:44.089514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': 'd8af5900-5251-4759-8aa6-7baffad6074a'} Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8af5900-5251-4759-8aa6-7baffad6074a could not be found. Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:05:44.090303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8af5900-5251-4759-8aa6-7baffad6074a could not be found. Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8af5900-5251-4759-8aa6-7baffad6074a could not be found. Jul 15 16:05:44.092040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:05:44.093224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] Returning 404 to user: Instance d8af5900-5251-4759-8aa6-7baffad6074a could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:05:44.093224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a5aa9c2e-ed86-45d2-bf0c-a5ba51c6ef9a tempest-VolumesSnapshotTestJSON-96866579 tempest-VolumesSnapshotTestJSON-96866579-project] 10.222.0.98 "GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a" status: 404 len: 111 microversion: 2.1 time: 0.031680 Jul 15 16:05:44.093224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 583/1162] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:05:44 2022] GET /compute/v2.1/servers/d8af5900-5251-4759-8aa6-7baffad6074a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:16.519938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=10 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:16.520666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:16.778356 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2d1b65db-cc0c-4a87-885f-52c48559abf2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:16.778898 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2d1b65db-cc0c-4a87-885f-52c48559abf2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:16.785769 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d1b65db-cc0c-4a87-885f-52c48559abf2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:16.786227 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d1b65db-cc0c-4a87-885f-52c48559abf2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:16.787059 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d1b65db-cc0c-4a87-885f-52c48559abf2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:16.787539 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2d1b65db-cc0c-4a87-885f-52c48559abf2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:16.813288 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2d1b65db-cc0c-4a87-885f-52c48559abf2 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/ips" status: 200 len: 148 microversion: 2.1 time: 0.298386 Jul 15 16:06:16.813892 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 580/1163] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Jul 15 16:06:16 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/ips => generated 148 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:06:19.826327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ff51f3d1-bc71-4efd-a028-3ab82a7f9b63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6a15d1-59f6-4a1b-a8f4-df09364b4a1f"}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:06:19.827474 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ff51f3d1-bc71-4efd-a028-3ab82a7f9b63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:19.835862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:19.837071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:19.839083 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff51f3d1-bc71-4efd-a028-3ab82a7f9b63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:19.839785 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff51f3d1-bc71-4efd-a028-3ab82a7f9b63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:19.840743 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff51f3d1-bc71-4efd-a028-3ab82a7f9b63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:19.841353 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ff51f3d1-bc71-4efd-a028-3ab82a7f9b63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:21.009431 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ff51f3d1-bc71-4efd-a028-3ab82a7f9b63 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "POST /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.187436 Jul 15 16:06:21.011788 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 584/1164] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Jul 15 16:06:19 2022] POST /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments => generated 194 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:06:27.594874 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:27.768129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-90caa13c-1334-4c51-a95a-6d7be555a53e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Action: 'create', calling method: .version_select at 0x7f510abaa040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1496139757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVlh4agC4uyTDV0pSjm2mWVQ83VRDY0zZFvvWDnj9MXb5cVIfkONylnzqWDzkt0dZy9+GpOboSwe5xOp6GZ2D7D6TOV0/pRJcOcVI9FjeQTI032Nicd7yvI2JbiIagyuA=="}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:06:27.783080 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-90caa13c-1334-4c51-a95a-6d7be555a53e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Getting quotas for project 801e210cf8c64e7184b178fbde47860c. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:06:27.787346 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-90caa13c-1334-4c51-a95a-6d7be555a53e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Getting quotas for user 14fecc08cd364a48a8640d522577aa39 and project 801e210cf8c64e7184b178fbde47860c. Resources: {'key_pairs'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:06:27.870231 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-90caa13c-1334-4c51-a95a-6d7be555a53e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.281111 Jul 15 16:06:27.870930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 581/1165] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 16:06:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:06:30.846817 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-28597632-bf1a-48bb-90ba-273d3d98f5ef tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:30.848066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-28597632-bf1a-48bb-90ba-273d3d98f5ef tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:30.856294 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:30.858787 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-28597632-bf1a-48bb-90ba-273d3d98f5ef tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:30.859686 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-28597632-bf1a-48bb-90ba-273d3d98f5ef tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:30.861338 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-28597632-bf1a-48bb-90ba-273d3d98f5ef tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:30.862041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-28597632-bf1a-48bb-90ba-273d3d98f5ef tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:30.999186 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-28597632-bf1a-48bb-90ba-273d3d98f5ef tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lazy-loading 'services' on Instance uuid 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:06:31.405350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-28597632-bf1a-48bb-90ba-273d3d98f5ef tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments/9b6a15d1-59f6-4a1b-a8f4-df09364b4a1f" status: 202 len: 0 microversion: 2.1 time: 0.563233 Jul 15 16:06:31.409746 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 585/1166] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Jul 15 16:06:30 2022] DELETE /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments/9b6a15d1-59f6-4a1b-a8f4-df09364b4a1f => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:06:31.414966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dd453508-03aa-4dae-9283-cfcc88e53adc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:31.416243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-dd453508-03aa-4dae-9283-cfcc88e53adc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:31.424331 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd453508-03aa-4dae-9283-cfcc88e53adc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:31.426476 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd453508-03aa-4dae-9283-cfcc88e53adc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:31.427367 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd453508-03aa-4dae-9283-cfcc88e53adc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:31.427930 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dd453508-03aa-4dae-9283-cfcc88e53adc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:31.460642 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dd453508-03aa-4dae-9283-cfcc88e53adc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050173 Jul 15 16:06:31.461549 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 582/1167] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:06:31 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:06:32.474629 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-39255c51-5d59-45ab-b205-5cc28501494a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:32.475882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-39255c51-5d59-45ab-b205-5cc28501494a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:32.482390 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-39255c51-5d59-45ab-b205-5cc28501494a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:32.483535 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-39255c51-5d59-45ab-b205-5cc28501494a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:32.493606 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-39255c51-5d59-45ab-b205-5cc28501494a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:32.493606 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-39255c51-5d59-45ab-b205-5cc28501494a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:32.516839 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-39255c51-5d59-45ab-b205-5cc28501494a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047257 Jul 15 16:06:32.517488 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 586/1168] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:06:32 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:06:33.529705 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-26705d37-b5ad-4689-867b-dbe89649a4eb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:33.530638 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-26705d37-b5ad-4689-867b-dbe89649a4eb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:33.537121 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-26705d37-b5ad-4689-867b-dbe89649a4eb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:33.537581 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-26705d37-b5ad-4689-867b-dbe89649a4eb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:33.538601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-26705d37-b5ad-4689-867b-dbe89649a4eb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:33.539053 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-26705d37-b5ad-4689-867b-dbe89649a4eb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:33.569429 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-26705d37-b5ad-4689-867b-dbe89649a4eb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043632 Jul 15 16:06:33.570002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 583/1169] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Jul 15 16:06:33 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 16:06:33.633137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3264132c-2239-495e-9771-c0c66fa360ab tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:33.633736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3264132c-2239-495e-9771-c0c66fa360ab tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:33.640129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3264132c-2239-495e-9771-c0c66fa360ab tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:33.645623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3264132c-2239-495e-9771-c0c66fa360ab tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:33.645623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3264132c-2239-495e-9771-c0c66fa360ab tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:33.645623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3264132c-2239-495e-9771-c0c66fa360ab tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:33.666503 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3264132c-2239-495e-9771-c0c66fa360ab tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:06:34.090126 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3264132c-2239-495e-9771-c0c66fa360ab tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 204 len: 0 microversion: 2.1 time: 0.460609 Jul 15 16:06:34.090873 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 587/1170] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:06:33 2022] DELETE /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:06:34.100107 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-dad3b6bd-dac2-439e-b837-7c67ca40817e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:34.100731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-dad3b6bd-dac2-439e-b837-7c67ca40817e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:34.106904 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dad3b6bd-dac2-439e-b837-7c67ca40817e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:34.107389 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dad3b6bd-dac2-439e-b837-7c67ca40817e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:34.108737 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dad3b6bd-dac2-439e-b837-7c67ca40817e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:34.109164 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-dad3b6bd-dac2-439e-b837-7c67ca40817e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:34.244194 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-dad3b6bd-dac2-439e-b837-7c67ca40817e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:34.251695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-dad3b6bd-dac2-439e-b837-7c67ca40817e tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1679 microversion: 2.1 time: 0.155610 Jul 15 16:06:34.252316 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 584/1171] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:34 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:35.269752 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c94f0120-fe90-418a-bfdc-1d3071a8f16d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:35.270461 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c94f0120-fe90-418a-bfdc-1d3071a8f16d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:35.277705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c94f0120-fe90-418a-bfdc-1d3071a8f16d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:35.278157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c94f0120-fe90-418a-bfdc-1d3071a8f16d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:35.278935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c94f0120-fe90-418a-bfdc-1d3071a8f16d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:35.279407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c94f0120-fe90-418a-bfdc-1d3071a8f16d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:35.456292 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c94f0120-fe90-418a-bfdc-1d3071a8f16d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:35.464853 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c94f0120-fe90-418a-bfdc-1d3071a8f16d tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1679 microversion: 2.1 time: 0.199363 Jul 15 16:06:35.465439 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 588/1172] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:35 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:36.482213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2480ad8e-f6e5-43f0-9bbb-386c895bfbbc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:36.483445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2480ad8e-f6e5-43f0-9bbb-386c895bfbbc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:36.489966 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2480ad8e-f6e5-43f0-9bbb-386c895bfbbc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:36.490429 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2480ad8e-f6e5-43f0-9bbb-386c895bfbbc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:36.491213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2480ad8e-f6e5-43f0-9bbb-386c895bfbbc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:36.491687 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2480ad8e-f6e5-43f0-9bbb-386c895bfbbc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:36.813709 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2480ad8e-f6e5-43f0-9bbb-386c895bfbbc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:36.822619 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2480ad8e-f6e5-43f0-9bbb-386c895bfbbc tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1679 microversion: 2.1 time: 0.344362 Jul 15 16:06:36.824352 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 585/1173] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:36 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1679 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:37.414873 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-51a47d19-d1ca-47b6-8bc4-64af55dfbc8c req-031ded8b-aba9-4ce7-9aa0-e4a12195ef66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457", "name": "network-vif-deleted", "tag": "12137d07-ce46-4b7b-aa5b-b78b14eede08"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:06:37.428392 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-51a47d19-d1ca-47b6-8bc4-64af55dfbc8c req-031ded8b-aba9-4ce7-9aa0-e4a12195ef66 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:37.428865 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-51a47d19-d1ca-47b6-8bc4-64af55dfbc8c req-031ded8b-aba9-4ce7-9aa0-e4a12195ef66 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:37.446535 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-51a47d19-d1ca-47b6-8bc4-64af55dfbc8c req-031ded8b-aba9-4ce7-9aa0-e4a12195ef66 service nova] Creating event network-vif-deleted:12137d07-ce46-4b7b-aa5b-b78b14eede08 for instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 on hv-cinder-83587 Jul 15 16:06:37.452490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-51a47d19-d1ca-47b6-8bc4-64af55dfbc8c req-031ded8b-aba9-4ce7-9aa0-e4a12195ef66 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040498 Jul 15 16:06:37.453453 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 589/1174] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:06:37.842060 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:37.842674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:37.845727 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=4 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:37.855089 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:37.875024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:37.875024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:37.875024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:37.950492 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:37.951055 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:37.951596 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lazy-loading 'fault' on Instance uuid 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:06:38.027923 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1157b91a306540dd98a072b1ea4941b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35d3e93d36040bba1bbb873e61d239a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:38.039543 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e5ea20bd-07ce-4de8-91ff-1486b1d8813c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 200 len: 1330 microversion: 2.1 time: 0.201203 Jul 15 16:06:38.040146 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 586/1175] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:37 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 1330 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:39.059057 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:39.060050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:39.068456 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:39.069033 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:39.069975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:39.070470 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:39.085596 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 HTTP/1.1 Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:06:39.089084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:39.090982 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457'} Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:39.092089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:39.095525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:39.098187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:39.098187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-a5e3c78a-b5eb-4fef-bff3-957ce49a0334 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 404 len: 111 microversion: 2.1 time: 0.034455 Jul 15 16:06:39.098187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 590/1176] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:39 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:39.098636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2aa95045-980c-4022-80ad-194be30cfa0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '.version_select at 0x7f510a8f8670>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:39.182209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2aa95045-980c-4022-80ad-194be30cfa0a tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791723333" status: 202 len: 0 microversion: 2.1 time: 0.087934 Jul 15 16:06:39.182759 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 587/1177] 10.222.0.98 () {58 vars in 1217 bytes} [Fri Jul 15 16:06:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791723333 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:06:41.471215 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:41.472056 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:41.478958 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:41.479538 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:41.480414 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:41.480861 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:41.504236 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 HTTP/1.1 Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:06:41.505995 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.510749 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457'} Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:41.511600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.514252 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.515641 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:41.515641 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-72fbddc9-9026-445b-b5e4-e79cebe551f8 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 404 len: 111 microversion: 2.1 time: 0.042339 Jul 15 16:06:41.515641 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 591/1178] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:06:41 2022] DELETE /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:41.517724 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:41.518538 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:41.525469 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:41.525928 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:41.526872 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:41.527345 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:41.545036 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 HTTP/1.1 Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:06:41.547243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.548893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457'} Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:41.549814 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. Jul 15 16:06:41.551403 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:41.552790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:41.552790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a79b66a0-3d81-4bad-8b11-3171c24507c4 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457" status: 404 len: 111 microversion: 2.1 time: 0.035376 Jul 15 16:06:41.552790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 588/1179] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:41 2022] GET /compute/v2.1/servers/8cdc5afb-8e4d-4c1d-bd30-23c9c5a5e457 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:42.834621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:42.835120 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:42.843238 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:42.843804 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:42.844664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:42.845179 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:42.860828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 HTTP/1.1 Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:06:42.862529 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.864009 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': 'bd957115-e1c8-4716-82fa-73ca85975a93'} Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:42.868948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.870241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.871621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:42.871621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e57e0dd6-fbcf-425c-b5d7-7365583ffdb9 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 404 len: 111 microversion: 2.1 time: 0.034555 Jul 15 16:06:42.871621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 592/1180] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:06:42 2022] DELETE /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:42.873789 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:42.874472 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: bd957115-e1c8-4716-82fa-73ca85975a93] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:42.880997 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:42.888887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:42.888887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:42.888887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:42.902893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 HTTP/1.1 Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:06:42.905094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.906755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': 'bd957115-e1c8-4716-82fa-73ca85975a93'} Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:42.907719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. Jul 15 16:06:42.909349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.911414 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance bd957115-e1c8-4716-82fa-73ca85975a93 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:42.912465 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-89fed4d6-0bc0-4c1e-98e2-ee1e45bd0d44 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93" status: 404 len: 111 microversion: 2.1 time: 0.043030 Jul 15 16:06:42.913612 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 589/1181] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:42 2022] GET /compute/v2.1/servers/bd957115-e1c8-4716-82fa-73ca85975a93 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:42.921762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:42.922264 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:42.929275 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:42.929799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:42.930603 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:42.931059 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:42.952664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa HTTP/1.1 Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:06:42.954243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.955646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '415beda2-d5fa-4cbe-99ae-9802fa6a0dfa'} Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:42.956799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.958266 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.963525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:42.963525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-011cd3fe-d043-47df-b355-9460164ddea6 tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 404 len: 111 microversion: 2.1 time: 0.038330 Jul 15 16:06:42.963525 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 593/1182] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:06:42 2022] DELETE /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:42.965755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:42.966369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:42.973340 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:42.973792 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:42.974609 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:42.975039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:42.993437 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa HTTP/1.1 Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:06:42.995825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.997252 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '415beda2-d5fa-4cbe-99ae-9802fa6a0dfa'} Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:42.998025 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. Jul 15 16:06:42.999521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:43.001938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 415beda2-d5fa-4cbe-99ae-9802fa6a0dfa could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:43.001938 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-54558bf8-c68d-47f0-94e5-03ad05e8ec3f tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa" status: 404 len: 111 microversion: 2.1 time: 0.040476 Jul 15 16:06:43.002422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 590/1183] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:42 2022] GET /compute/v2.1/servers/415beda2-d5fa-4cbe-99ae-9802fa6a0dfa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:44.290897 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:44.292091 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:44.318350 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:44.318793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:44.319824 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:44.320267 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:44.337566 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf HTTP/1.1 Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:06:44.340042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.341705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '03ed846f-5dcd-4d82-9aef-bd786bf6a6cf'} Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:44.342705 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.344582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.348093 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:44.349261 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f4230f14-cd5a-47b6-aa7e-0bdb25a45ccb tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "DELETE /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 404 len: 111 microversion: 2.1 time: 0.062150 Jul 15 16:06:44.349845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 594/1184] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:06:44 2022] DELETE /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:44.358423 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:44.359265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] [instance: 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:44.366678 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:44.372090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:44.372090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:44.372090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:44.390324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] HTTP exception thrown: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Request method failure captured: Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf HTTP/1.1 Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0Y4Ol3rXFfEa8BCIG4pd-JSJyyg6sKWoFNKYLcle4rMN-BYkXaoR5kljUu6AUK1G5hMfcxp1KVMnYlHSSDA4zwqGL04LeLdAk-40Aw7vRfjXy_j-yYnGrLHusoBX_vPxIVwtu78eYUB2SB7B8l4QvTghmyDjJaZx-XxL80xhoE4OihQ Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:06:44.392542 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c35d3e93d36040bba1bbb873e61d239a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: c35d3e93d36040bba1bbb873e61d239a Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047069137 Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 1157b91a306540dd98a072b1ea4941b2 Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-AttachVolumeNegativeTest-1047069137-project Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.394101 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '03ed846f-5dcd-4d82-9aef-bd786bf6a6cf'} Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:06:44.394908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. Jul 15 16:06:44.396203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:06:44.399988 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] Returning 404 to user: Instance 03ed846f-5dcd-4d82-9aef-bd786bf6a6cf could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:06:44.401305 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bfb175cd-a62d-4630-b61b-aecd6139313c tempest-AttachVolumeNegativeTest-1047069137 tempest-AttachVolumeNegativeTest-1047069137-project] 10.222.0.98 "GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf" status: 404 len: 111 microversion: 2.1 time: 0.047143 Jul 15 16:06:44.408736 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 591/1185] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:44 2022] GET /compute/v2.1/servers/03ed846f-5dcd-4d82-9aef-bd786bf6a6cf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:06:48.504669 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:06:48.505262 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:06:49.359754 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-130667e7-bca8-4954-8a96-b2bd542c60e0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Action: 'create', calling method: .version_select at 0x7f510aa73d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1217782638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImuXL9pLr8WdGxkSLY84suw93+l9mbuC2AmzYYZairMoPjMqKXwzwY92W8tk+89hYg1dvuMotlwgFUQxWMMVluaxweqr4ewpxg7ZnNrNc/uYdpXvovpd8APZMco4DQV7Q=="}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:06:49.373863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-130667e7-bca8-4954-8a96-b2bd542c60e0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Getting quotas for project b5530af77f8d4d319251e5aa27d8a536. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:06:49.377885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-130667e7-bca8-4954-8a96-b2bd542c60e0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Getting quotas for user 4578eaca578d4064977c32a2e8eb3267 and project b5530af77f8d4d319251e5aa27d8a536. Resources: {'key_pairs'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:06:49.391901 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR oslo.messaging._drivers.impl_rabbit [None req-130667e7-bca8-4954-8a96-b2bd542c60e0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [918adfdc-5929-4f43-af64-4274d9a811b1] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 16:06:50.400511 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [None req-130667e7-bca8-4954-8a96-b2bd542c60e0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [918adfdc-5929-4f43-af64-4274d9a811b1] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 36512. Jul 15 16:06:50.491405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-130667e7-bca8-4954-8a96-b2bd542c60e0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.339917 Jul 15 16:06:50.491405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 595/1186] 10.222.0.98 () {60 vars in 1158 bytes} [Fri Jul 15 16:06:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:06:53.348894 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1455947873", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1496139757", "security_groups": [{"name": "tempest-secgroup-smoke-217764526"}], "block_device_mapping_v2": [{"uuid": "57ba7c1b-f257-43cd-9176-4eb120b0c00b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9dd76655-49f1-4b8f-9861-8e5cd93edef6"}]}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:06:53.487617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] validate_networks() for [('9dd76655-49f1-4b8f-9861-8e5cd93edef6', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:06:54.235463 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:06:54.235889 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:06:54.236353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:06:54.236756 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:06:54.237162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:06:54.252180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:54.252180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:54.252180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:54.252180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:54.265530 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Getting quotas for project 801e210cf8c64e7184b178fbde47860c. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:06:54.269624 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Getting quotas for user 14fecc08cd364a48a8640d522577aa39 and project 801e210cf8c64e7184b178fbde47860c. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:06:54.367324 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:06:54.369648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57ba7c1b-f257-43cd-9176-4eb120b0c00b',volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:06:55.046300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7c7297bf-675e-40aa-8ba8-cc6cb76411a0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.701248 Jul 15 16:06:55.053896 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 592/1187] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:06:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 16:06:55.057213 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:55.065387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ddac062b-4cff-448c-ba35-b779187ff477 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:55.065387 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ddac062b-4cff-448c-ba35-b779187ff477 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:55.139643 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ddac062b-4cff-448c-ba35-b779187ff477 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:55.147950 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ddac062b-4cff-448c-ba35-b779187ff477 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1095 microversion: 2.1 time: 0.092035 Jul 15 16:06:55.158338 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 596/1188] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:55 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:56.164789 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-12177530-3526-4a77-b70b-33f10ebd7e70 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:56.170871 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-12177530-3526-4a77-b70b-33f10ebd7e70 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:56.231228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-12177530-3526-4a77-b70b-33f10ebd7e70 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:56.238095 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-12177530-3526-4a77-b70b-33f10ebd7e70 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1095 microversion: 2.1 time: 0.077243 Jul 15 16:06:56.238657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 593/1189] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:56 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:57.255859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-760e250c-e719-479e-af79-4e565cd6630e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:57.256479 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-760e250c-e719-479e-af79-4e565cd6630e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:57.264152 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-760e250c-e719-479e-af79-4e565cd6630e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:57.264600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-760e250c-e719-479e-af79-4e565cd6630e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:57.266092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-760e250c-e719-479e-af79-4e565cd6630e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:57.266524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-760e250c-e719-479e-af79-4e565cd6630e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:57.335282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-760e250c-e719-479e-af79-4e565cd6630e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:57.342825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-760e250c-e719-479e-af79-4e565cd6630e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1193 microversion: 2.1 time: 0.090793 Jul 15 16:06:57.344627 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 597/1190] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:57 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:58.362703 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2dcc58d2-0eb1-427d-b97e-2f2e538c8c3f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:58.363355 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2dcc58d2-0eb1-427d-b97e-2f2e538c8c3f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:58.365805 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:58.370665 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2dcc58d2-0eb1-427d-b97e-2f2e538c8c3f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:58.371123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2dcc58d2-0eb1-427d-b97e-2f2e538c8c3f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:58.371937 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2dcc58d2-0eb1-427d-b97e-2f2e538c8c3f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:58.372382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2dcc58d2-0eb1-427d-b97e-2f2e538c8c3f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:58.376495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=47 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:06:58.451688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2dcc58d2-0eb1-427d-b97e-2f2e538c8c3f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:58.460220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2dcc58d2-0eb1-427d-b97e-2f2e538c8c3f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1211 microversion: 2.1 time: 0.101969 Jul 15 16:06:58.461463 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 594/1191] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:58 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:59.478613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ab986139-f301-4beb-b320-5d80dba63ed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:06:59.479259 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ab986139-f301-4beb-b320-5d80dba63ed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:06:59.487153 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ab986139-f301-4beb-b320-5d80dba63ed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:59.489558 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ab986139-f301-4beb-b320-5d80dba63ed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:59.492341 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ab986139-f301-4beb-b320-5d80dba63ed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:59.493154 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ab986139-f301-4beb-b320-5d80dba63ed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:59.663245 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ab986139-f301-4beb-b320-5d80dba63ed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:06:59.671711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ab986139-f301-4beb-b320-5d80dba63ed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1278 microversion: 2.1 time: 0.196727 Jul 15 16:06:59.672215 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 598/1192] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:06:59 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:06:59.839546 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-a1c47032-9d9f-4320-a386-3ac984957454 req-fb331951-fb62-432b-9533-a761c51d4695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "418c00e7-672a-4442-95e9-042c560955ff", "tag": "e0c4457c-67c3-4bf6-8c60-587641b47e7f"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:06:59.850970 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a1c47032-9d9f-4320-a386-3ac984957454 req-fb331951-fb62-432b-9533-a761c51d4695 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:06:59.851772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a1c47032-9d9f-4320-a386-3ac984957454 req-fb331951-fb62-432b-9533-a761c51d4695 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:06:59.869175 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-a1c47032-9d9f-4320-a386-3ac984957454 req-fb331951-fb62-432b-9533-a761c51d4695 service nova] Creating event network-changed:e0c4457c-67c3-4bf6-8c60-587641b47e7f for instance 418c00e7-672a-4442-95e9-042c560955ff on hv-cinder-83587 Jul 15 16:06:59.875821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-a1c47032-9d9f-4320-a386-3ac984957454 req-fb331951-fb62-432b-9533-a761c51d4695 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040515 Jul 15 16:06:59.876674 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 595/1193] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:07:00.688397 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c4429b32-90c9-49a7-9e61-f3cd2f6a706b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:00.689010 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c4429b32-90c9-49a7-9e61-f3cd2f6a706b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:00.696448 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c4429b32-90c9-49a7-9e61-f3cd2f6a706b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:00.703342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c4429b32-90c9-49a7-9e61-f3cd2f6a706b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:00.703342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c4429b32-90c9-49a7-9e61-f3cd2f6a706b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:00.703342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c4429b32-90c9-49a7-9e61-f3cd2f6a706b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:00.851655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c4429b32-90c9-49a7-9e61-f3cd2f6a706b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:00.859927 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c4429b32-90c9-49a7-9e61-f3cd2f6a706b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.175422 Jul 15 16:07:00.871251 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 599/1194] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:00 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:01.880784 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e3120f33-19b6-42c2-b011-011b86282b8f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:01.881498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e3120f33-19b6-42c2-b011-011b86282b8f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:01.889223 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e3120f33-19b6-42c2-b011-011b86282b8f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:01.889677 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e3120f33-19b6-42c2-b011-011b86282b8f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:01.890969 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e3120f33-19b6-42c2-b011-011b86282b8f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:01.891440 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e3120f33-19b6-42c2-b011-011b86282b8f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:02.040339 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e3120f33-19b6-42c2-b011-011b86282b8f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:02.047876 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e3120f33-19b6-42c2-b011-011b86282b8f tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.172151 Jul 15 16:07:02.048472 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 596/1195] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:01 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:03.066131 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-91a23a35-29ea-4ae9-bd6f-b22ab0c43bfb tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:03.066849 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-91a23a35-29ea-4ae9-bd6f-b22ab0c43bfb tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:03.069569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:03.075164 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-91a23a35-29ea-4ae9-bd6f-b22ab0c43bfb tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:03.075646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-91a23a35-29ea-4ae9-bd6f-b22ab0c43bfb tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:03.076433 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-91a23a35-29ea-4ae9-bd6f-b22ab0c43bfb tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:03.076863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-91a23a35-29ea-4ae9-bd6f-b22ab0c43bfb tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:03.222532 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-91a23a35-29ea-4ae9-bd6f-b22ab0c43bfb tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:03.229974 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-91a23a35-29ea-4ae9-bd6f-b22ab0c43bfb tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.168904 Jul 15 16:07:03.230800 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 600/1196] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:03 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:04.247849 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-b780327a-ac79-4a7d-9402-d48f8fbaad8e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:04.248471 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-b780327a-ac79-4a7d-9402-d48f8fbaad8e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:04.255914 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b780327a-ac79-4a7d-9402-d48f8fbaad8e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:04.256372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b780327a-ac79-4a7d-9402-d48f8fbaad8e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:04.257152 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b780327a-ac79-4a7d-9402-d48f8fbaad8e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:04.257592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-b780327a-ac79-4a7d-9402-d48f8fbaad8e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:04.258142 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:04.394319 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-b780327a-ac79-4a7d-9402-d48f8fbaad8e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:04.401916 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-b780327a-ac79-4a7d-9402-d48f8fbaad8e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.158047 Jul 15 16:07:04.402518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 597/1197] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:04 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:07:05.419160 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-584045c4-36d4-4d50-87e3-5f12a9bdfed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:05.419799 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-584045c4-36d4-4d50-87e3-5f12a9bdfed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:05.422782 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=6 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:05.427633 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-584045c4-36d4-4d50-87e3-5f12a9bdfed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:05.428080 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-584045c4-36d4-4d50-87e3-5f12a9bdfed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:05.428844 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-584045c4-36d4-4d50-87e3-5f12a9bdfed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:05.429277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-584045c4-36d4-4d50-87e3-5f12a9bdfed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:05.562233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-584045c4-36d4-4d50-87e3-5f12a9bdfed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:05.569631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-584045c4-36d4-4d50-87e3-5f12a9bdfed0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.154346 Jul 15 16:07:05.570208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 601/1198] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:05 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:06.585905 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-f8afb40b-b575-43e0-a669-690825140784 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:06.586523 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-f8afb40b-b575-43e0-a669-690825140784 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:06.588825 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=8 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:06.594049 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f8afb40b-b575-43e0-a669-690825140784 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:06.594510 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f8afb40b-b575-43e0-a669-690825140784 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:06.595262 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f8afb40b-b575-43e0-a669-690825140784 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:06.595724 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-f8afb40b-b575-43e0-a669-690825140784 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:06.744322 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-f8afb40b-b575-43e0-a669-690825140784 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:06.753919 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-f8afb40b-b575-43e0-a669-690825140784 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.171821 Jul 15 16:07:06.754500 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 598/1199] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:06 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:07.770430 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e931d9c0-bb18-44b8-b5c8-2f27b2dd74ad tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:07.771179 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e931d9c0-bb18-44b8-b5c8-2f27b2dd74ad tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:07.777678 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e931d9c0-bb18-44b8-b5c8-2f27b2dd74ad tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:07.778135 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e931d9c0-bb18-44b8-b5c8-2f27b2dd74ad tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:07.778910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e931d9c0-bb18-44b8-b5c8-2f27b2dd74ad tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:07.779371 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e931d9c0-bb18-44b8-b5c8-2f27b2dd74ad tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:07.913012 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e931d9c0-bb18-44b8-b5c8-2f27b2dd74ad tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:07.921654 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e931d9c0-bb18-44b8-b5c8-2f27b2dd74ad tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.154033 Jul 15 16:07:07.928193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 602/1200] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:07 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:08.938342 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-486b6b79-b3df-4ff7-9104-85a736f3049a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:08.939270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-486b6b79-b3df-4ff7-9104-85a736f3049a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:08.945853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-486b6b79-b3df-4ff7-9104-85a736f3049a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:08.947151 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-486b6b79-b3df-4ff7-9104-85a736f3049a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:08.947986 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-486b6b79-b3df-4ff7-9104-85a736f3049a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:08.949944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-486b6b79-b3df-4ff7-9104-85a736f3049a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:09.092042 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-486b6b79-b3df-4ff7-9104-85a736f3049a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:09.100468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-486b6b79-b3df-4ff7-9104-85a736f3049a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.166299 Jul 15 16:07:09.101589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 599/1201] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:08 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:10.117321 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-665920c6-88f6-4598-b3eb-9133de34b4ef tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:10.117932 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-665920c6-88f6-4598-b3eb-9133de34b4ef tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:10.124482 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-665920c6-88f6-4598-b3eb-9133de34b4ef tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:10.124929 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-665920c6-88f6-4598-b3eb-9133de34b4ef tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:10.125695 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-665920c6-88f6-4598-b3eb-9133de34b4ef tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:10.126132 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-665920c6-88f6-4598-b3eb-9133de34b4ef tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:10.253524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-665920c6-88f6-4598-b3eb-9133de34b4ef tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:10.261066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-665920c6-88f6-4598-b3eb-9133de34b4ef tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.147522 Jul 15 16:07:10.261634 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 603/1202] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:10 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:11.120773 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-a366ebfc-8e61-488f-b7b9-545420ebf09e req-277ab858-a5cf-4bf9-9974-6d18f184dfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "418c00e7-672a-4442-95e9-042c560955ff", "name": "network-vif-plugged", "status": "completed", "tag": "e0c4457c-67c3-4bf6-8c60-587641b47e7f"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:07:11.131731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a366ebfc-8e61-488f-b7b9-545420ebf09e req-277ab858-a5cf-4bf9-9974-6d18f184dfc4 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:11.132182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a366ebfc-8e61-488f-b7b9-545420ebf09e req-277ab858-a5cf-4bf9-9974-6d18f184dfc4 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:11.143890 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-a366ebfc-8e61-488f-b7b9-545420ebf09e req-277ab858-a5cf-4bf9-9974-6d18f184dfc4 service nova] Creating event network-vif-plugged:e0c4457c-67c3-4bf6-8c60-587641b47e7f for instance 418c00e7-672a-4442-95e9-042c560955ff on hv-cinder-83587 Jul 15 16:07:11.148926 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-a366ebfc-8e61-488f-b7b9-545420ebf09e req-277ab858-a5cf-4bf9-9974-6d18f184dfc4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031839 Jul 15 16:07:11.150039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 600/1203] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:07:11.277963 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-cc189a33-fc11-4bd9-90fd-22131ca9d188 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:11.278580 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-cc189a33-fc11-4bd9-90fd-22131ca9d188 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:11.287246 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cc189a33-fc11-4bd9-90fd-22131ca9d188 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:11.287724 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cc189a33-fc11-4bd9-90fd-22131ca9d188 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:11.288508 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cc189a33-fc11-4bd9-90fd-22131ca9d188 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:11.288951 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-cc189a33-fc11-4bd9-90fd-22131ca9d188 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:11.433481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-cc189a33-fc11-4bd9-90fd-22131ca9d188 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:11.442260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-cc189a33-fc11-4bd9-90fd-22131ca9d188 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.167093 Jul 15 16:07:11.442260 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 604/1204] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:11 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:12.459493 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-74fe3499-c1b1-4578-9ad2-c13d62cd4910 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:12.460398 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-74fe3499-c1b1-4578-9ad2-c13d62cd4910 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:12.466689 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74fe3499-c1b1-4578-9ad2-c13d62cd4910 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:12.467150 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74fe3499-c1b1-4578-9ad2-c13d62cd4910 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:12.467956 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74fe3499-c1b1-4578-9ad2-c13d62cd4910 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:12.469217 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-74fe3499-c1b1-4578-9ad2-c13d62cd4910 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:12.606188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-74fe3499-c1b1-4578-9ad2-c13d62cd4910 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:12.613755 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-74fe3499-c1b1-4578-9ad2-c13d62cd4910 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.159109 Jul 15 16:07:12.614482 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 601/1205] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:12 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:13.631224 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-931139d0-c1e6-4ca1-b344-3a6cb2d36dea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:13.631867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-931139d0-c1e6-4ca1-b344-3a6cb2d36dea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:13.638382 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-931139d0-c1e6-4ca1-b344-3a6cb2d36dea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:13.643203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-931139d0-c1e6-4ca1-b344-3a6cb2d36dea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:13.643203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-931139d0-c1e6-4ca1-b344-3a6cb2d36dea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:13.643203 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-931139d0-c1e6-4ca1-b344-3a6cb2d36dea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:13.778661 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-931139d0-c1e6-4ca1-b344-3a6cb2d36dea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:13.786661 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-931139d0-c1e6-4ca1-b344-3a6cb2d36dea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1266 microversion: 2.1 time: 0.159295 Jul 15 16:07:13.787229 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 605/1206] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:13 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:14.802835 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5b5e7141-8826-4f31-bac4-0f9f00896ef8 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:14.803568 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5b5e7141-8826-4f31-bac4-0f9f00896ef8 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:14.810339 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b5e7141-8826-4f31-bac4-0f9f00896ef8 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:14.810794 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b5e7141-8826-4f31-bac4-0f9f00896ef8 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:14.811620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b5e7141-8826-4f31-bac4-0f9f00896ef8 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:14.812616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b5e7141-8826-4f31-bac4-0f9f00896ef8 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:14.945474 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5b5e7141-8826-4f31-bac4-0f9f00896ef8 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:14.952958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5b5e7141-8826-4f31-bac4-0f9f00896ef8 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1454 microversion: 2.1 time: 0.153907 Jul 15 16:07:14.953521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 602/1207] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:14 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:14.968444 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-3b7b259f-5961-4828-8cad-0d0cc4f2990d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:14.969338 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-3b7b259f-5961-4828-8cad-0d0cc4f2990d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:14.975655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3b7b259f-5961-4828-8cad-0d0cc4f2990d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:14.976103 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3b7b259f-5961-4828-8cad-0d0cc4f2990d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:14.976927 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3b7b259f-5961-4828-8cad-0d0cc4f2990d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:14.977300 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-3b7b259f-5961-4828-8cad-0d0cc4f2990d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:15.113316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-3b7b259f-5961-4828-8cad-0d0cc4f2990d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:15.120885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-3b7b259f-5961-4828-8cad-0d0cc4f2990d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1454 microversion: 2.1 time: 0.156258 Jul 15 16:07:15.121882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 606/1208] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:14 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:17.612946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-c6085cd9-e769-420d-9bc2-6deb829ea01e req-b3c74466-7702-4c64-a97f-4cec6f5a02d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "418c00e7-672a-4442-95e9-042c560955ff", "tag": "e0c4457c-67c3-4bf6-8c60-587641b47e7f"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:07:17.621496 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-c6085cd9-e769-420d-9bc2-6deb829ea01e req-b3c74466-7702-4c64-a97f-4cec6f5a02d1 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:17.621932 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-c6085cd9-e769-420d-9bc2-6deb829ea01e req-b3c74466-7702-4c64-a97f-4cec6f5a02d1 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:17.633265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-c6085cd9-e769-420d-9bc2-6deb829ea01e req-b3c74466-7702-4c64-a97f-4cec6f5a02d1 service nova] Creating event network-changed:e0c4457c-67c3-4bf6-8c60-587641b47e7f for instance 418c00e7-672a-4442-95e9-042c560955ff on hv-cinder-83587 Jul 15 16:07:17.638349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-c6085cd9-e769-420d-9bc2-6deb829ea01e req-b3c74466-7702-4c64-a97f-4cec6f5a02d1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165363 Jul 15 16:07:17.638962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 603/1209] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:07:17.932241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2127334960", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1217782638", "security_groups": [{"name": "tempest-secgroup-smoke-409631122"}], "networks": [{"uuid": "1e6da08d-e9e6-438b-8c26-304754916cd4"}], "block_device_mapping_v2": [{"uuid": "01d2c33b-2379-4895-91ad-345f7c6d67b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:07:18.069364 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] validate_networks() for [('1e6da08d-e9e6-438b-8c26-304754916cd4', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:07:18.491193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:07:18.491766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:07:18.492327 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:07:18.492806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:07:18.493332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:07:18.502373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:18.502907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:18.503750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:18.504189 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:18.523375 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Getting quotas for project b5530af77f8d4d319251e5aa27d8a536. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:07:18.527571 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Getting quotas for user 4578eaca578d4064977c32a2e8eb3267 and project b5530af77f8d4d319251e5aa27d8a536. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:07:18.588769 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:07:18.591096 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01d2c33b-2379-4895-91ad-345f7c6d67b4',volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:07:18.989718 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e485cb7a-37a4-4310-acc9-267e8fee0fef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.061548 Jul 15 16:07:18.990621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 607/1210] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:07:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 16:07:19.002249 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3733affd-7fcb-4518-a8b8-6b2b33a063c4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:19.003066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3733affd-7fcb-4518-a8b8-6b2b33a063c4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:19.061086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3733affd-7fcb-4518-a8b8-6b2b33a063c4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:19.069115 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3733affd-7fcb-4518-a8b8-6b2b33a063c4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1089 microversion: 2.1 time: 0.072325 Jul 15 16:07:19.069711 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 604/1211] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:18 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:07:20.086775 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-46acd906-75e6-47f3-a333-4a3bb4cb78a6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:20.087462 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-46acd906-75e6-47f3-a333-4a3bb4cb78a6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:20.145626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-46acd906-75e6-47f3-a333-4a3bb4cb78a6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:20.152532 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-46acd906-75e6-47f3-a333-4a3bb4cb78a6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1089 microversion: 2.1 time: 0.070468 Jul 15 16:07:20.153113 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 608/1212] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:20 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:21.170737 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-745b5386-e581-43d7-9fed-3eab654b40a0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:21.171851 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-745b5386-e581-43d7-9fed-3eab654b40a0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:21.181998 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-745b5386-e581-43d7-9fed-3eab654b40a0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:21.182459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-745b5386-e581-43d7-9fed-3eab654b40a0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:21.183248 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-745b5386-e581-43d7-9fed-3eab654b40a0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:21.184823 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-745b5386-e581-43d7-9fed-3eab654b40a0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:21.249024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-745b5386-e581-43d7-9fed-3eab654b40a0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:21.256824 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-745b5386-e581-43d7-9fed-3eab654b40a0 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1187 microversion: 2.1 time: 0.090050 Jul 15 16:07:21.257392 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 605/1213] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:21 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:22.274931 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-360e66c0-de30-448b-bc92-8316a6481284 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:22.275796 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-360e66c0-de30-448b-bc92-8316a6481284 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:22.283759 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-360e66c0-de30-448b-bc92-8316a6481284 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:22.284219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-360e66c0-de30-448b-bc92-8316a6481284 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:22.285001 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-360e66c0-de30-448b-bc92-8316a6481284 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:22.285447 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-360e66c0-de30-448b-bc92-8316a6481284 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:22.348633 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-360e66c0-de30-448b-bc92-8316a6481284 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:22.356408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-360e66c0-de30-448b-bc92-8316a6481284 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1205 microversion: 2.1 time: 0.086231 Jul 15 16:07:22.361490 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 609/1214] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:22 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1205 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:23.373235 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1001dd4d-bfd6-4c7a-b3d4-2d15ad2d49b6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:23.373862 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1001dd4d-bfd6-4c7a-b3d4-2d15ad2d49b6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:23.388088 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1001dd4d-bfd6-4c7a-b3d4-2d15ad2d49b6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:23.388556 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1001dd4d-bfd6-4c7a-b3d4-2d15ad2d49b6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:23.389362 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1001dd4d-bfd6-4c7a-b3d4-2d15ad2d49b6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:23.389946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1001dd4d-bfd6-4c7a-b3d4-2d15ad2d49b6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:23.572613 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-1001dd4d-bfd6-4c7a-b3d4-2d15ad2d49b6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:23.581798 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1001dd4d-bfd6-4c7a-b3d4-2d15ad2d49b6 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1272 microversion: 2.1 time: 0.212350 Jul 15 16:07:23.582694 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 606/1215] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:23 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:23.889065 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-4e15a201-1913-4716-a95a-546f8ef38f36 req-6fd5ac54-2054-40cb-9f68-04ff3a6d12ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295f8b34-f641-4a04-91cb-c76c493e9cb4", "tag": "b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:07:23.899489 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-4e15a201-1913-4716-a95a-546f8ef38f36 req-6fd5ac54-2054-40cb-9f68-04ff3a6d12ac service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:23.900214 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-4e15a201-1913-4716-a95a-546f8ef38f36 req-6fd5ac54-2054-40cb-9f68-04ff3a6d12ac service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:23.913236 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-4e15a201-1913-4716-a95a-546f8ef38f36 req-6fd5ac54-2054-40cb-9f68-04ff3a6d12ac service nova] Creating event network-changed:b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1 for instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 on hv-cinder-83587 Jul 15 16:07:23.919885 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-4e15a201-1913-4716-a95a-546f8ef38f36 req-6fd5ac54-2054-40cb-9f68-04ff3a6d12ac service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036048 Jul 15 16:07:23.920504 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 610/1216] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:07:24.598811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d01c47d2-b066-44e2-8a35-94a310778727 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:24.599480 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d01c47d2-b066-44e2-8a35-94a310778727 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:24.606636 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d01c47d2-b066-44e2-8a35-94a310778727 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:24.607180 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d01c47d2-b066-44e2-8a35-94a310778727 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:24.608039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d01c47d2-b066-44e2-8a35-94a310778727 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:24.608478 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d01c47d2-b066-44e2-8a35-94a310778727 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:24.819947 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d01c47d2-b066-44e2-8a35-94a310778727 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:24.831505 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d01c47d2-b066-44e2-8a35-94a310778727 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.233066 Jul 15 16:07:24.832165 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 607/1217] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:24 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:07:25.850340 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f5d87d88-cc1c-4761-9a16-5b47bbdb3b19 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:25.851040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f5d87d88-cc1c-4761-9a16-5b47bbdb3b19 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:25.857373 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5d87d88-cc1c-4761-9a16-5b47bbdb3b19 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:25.857827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5d87d88-cc1c-4761-9a16-5b47bbdb3b19 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:25.859222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5d87d88-cc1c-4761-9a16-5b47bbdb3b19 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:25.859703 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f5d87d88-cc1c-4761-9a16-5b47bbdb3b19 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:25.994040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f5d87d88-cc1c-4761-9a16-5b47bbdb3b19 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:26.001484 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f5d87d88-cc1c-4761-9a16-5b47bbdb3b19 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.155941 Jul 15 16:07:26.002051 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 611/1218] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:25 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:27.017890 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ebbe6bda-38e0-4fb3-8113-532f90981f21 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:27.018493 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ebbe6bda-38e0-4fb3-8113-532f90981f21 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:27.024893 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ebbe6bda-38e0-4fb3-8113-532f90981f21 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:27.025335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ebbe6bda-38e0-4fb3-8113-532f90981f21 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:27.026090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ebbe6bda-38e0-4fb3-8113-532f90981f21 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:27.026527 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ebbe6bda-38e0-4fb3-8113-532f90981f21 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:27.158117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ebbe6bda-38e0-4fb3-8113-532f90981f21 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:27.168086 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ebbe6bda-38e0-4fb3-8113-532f90981f21 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.153989 Jul 15 16:07:27.168653 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 608/1219] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:27 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:28.185092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4bfe0ca0-9332-4259-9c4c-4942c2809d80 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:28.185745 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4bfe0ca0-9332-4259-9c4c-4942c2809d80 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:28.192565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4bfe0ca0-9332-4259-9c4c-4942c2809d80 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:28.193021 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4bfe0ca0-9332-4259-9c4c-4942c2809d80 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:28.193793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4bfe0ca0-9332-4259-9c4c-4942c2809d80 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:28.194235 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4bfe0ca0-9332-4259-9c4c-4942c2809d80 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:28.330717 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-4bfe0ca0-9332-4259-9c4c-4942c2809d80 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:28.338233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4bfe0ca0-9332-4259-9c4c-4942c2809d80 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.157078 Jul 15 16:07:28.338806 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 612/1220] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:28 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:29.356137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3c447429-5e57-43e2-93d2-f636c154debe tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:29.356702 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3c447429-5e57-43e2-93d2-f636c154debe tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:29.359797 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:29.364751 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3c447429-5e57-43e2-93d2-f636c154debe tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:29.365206 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3c447429-5e57-43e2-93d2-f636c154debe tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:29.365980 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3c447429-5e57-43e2-93d2-f636c154debe tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:29.366422 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3c447429-5e57-43e2-93d2-f636c154debe tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:29.499632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3c447429-5e57-43e2-93d2-f636c154debe tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:29.507090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3c447429-5e57-43e2-93d2-f636c154debe tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.154875 Jul 15 16:07:29.507689 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 609/1221] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:29 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:30.529941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8737eded-ced5-4729-9454-f60207e6ada9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:30.529941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8737eded-ced5-4729-9454-f60207e6ada9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:30.529941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:30.529941 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=8 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:30.532820 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8737eded-ced5-4729-9454-f60207e6ada9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:30.533278 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8737eded-ced5-4729-9454-f60207e6ada9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:30.534075 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8737eded-ced5-4729-9454-f60207e6ada9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:30.534495 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8737eded-ced5-4729-9454-f60207e6ada9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:30.538277 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=83 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:30.679846 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8737eded-ced5-4729-9454-f60207e6ada9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:30.688082 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8737eded-ced5-4729-9454-f60207e6ada9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.167917 Jul 15 16:07:30.688659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 613/1222] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:30 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:31.705504 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-825ef840-f0bf-4560-bad4-5ef62de8bb58 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:31.706123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-825ef840-f0bf-4560-bad4-5ef62de8bb58 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:31.712998 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-825ef840-f0bf-4560-bad4-5ef62de8bb58 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:31.713454 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-825ef840-f0bf-4560-bad4-5ef62de8bb58 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:31.714226 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-825ef840-f0bf-4560-bad4-5ef62de8bb58 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:31.714666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-825ef840-f0bf-4560-bad4-5ef62de8bb58 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:31.717243 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=78 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:31.846547 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-825ef840-f0bf-4560-bad4-5ef62de8bb58 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:31.853995 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-825ef840-f0bf-4560-bad4-5ef62de8bb58 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.152895 Jul 15 16:07:31.854557 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 610/1223] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:31 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:32.870494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0ae32b78-d95c-4675-8633-27d73f561e13 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:32.871112 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0ae32b78-d95c-4675-8633-27d73f561e13 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:32.878417 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0ae32b78-d95c-4675-8633-27d73f561e13 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:32.878872 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0ae32b78-d95c-4675-8633-27d73f561e13 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:32.879683 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0ae32b78-d95c-4675-8633-27d73f561e13 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:32.880126 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0ae32b78-d95c-4675-8633-27d73f561e13 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:33.023699 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0ae32b78-d95c-4675-8633-27d73f561e13 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:33.033209 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0ae32b78-d95c-4675-8633-27d73f561e13 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.167089 Jul 15 16:07:33.033979 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 614/1224] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:32 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:34.050085 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-97d14ac8-2518-4bd0-955b-2a01c51df988 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:34.050722 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-97d14ac8-2518-4bd0-955b-2a01c51df988 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:34.053206 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=36 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:34.057972 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-97d14ac8-2518-4bd0-955b-2a01c51df988 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:34.058432 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-97d14ac8-2518-4bd0-955b-2a01c51df988 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:34.059207 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-97d14ac8-2518-4bd0-955b-2a01c51df988 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:34.059671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-97d14ac8-2518-4bd0-955b-2a01c51df988 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:34.197494 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-97d14ac8-2518-4bd0-955b-2a01c51df988 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:34.205204 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-97d14ac8-2518-4bd0-955b-2a01c51df988 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.159128 Jul 15 16:07:34.205771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 611/1225] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:34 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:35.221578 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dd63315b-cad1-4f4c-8e4b-7bf1173404a7 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:35.222192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dd63315b-cad1-4f4c-8e4b-7bf1173404a7 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:35.224545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:07:35.229249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd63315b-cad1-4f4c-8e4b-7bf1173404a7 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:35.229702 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd63315b-cad1-4f4c-8e4b-7bf1173404a7 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:35.230478 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd63315b-cad1-4f4c-8e4b-7bf1173404a7 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:35.230917 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd63315b-cad1-4f4c-8e4b-7bf1173404a7 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:35.367481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-dd63315b-cad1-4f4c-8e4b-7bf1173404a7 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:35.375552 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dd63315b-cad1-4f4c-8e4b-7bf1173404a7 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.158025 Jul 15 16:07:35.376120 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 615/1226] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:35 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:35.530255 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-04add58f-e6ad-42cf-93b4-983c7b1e19d7 req-afd12a30-ed38-436d-998c-4cbd5d19cb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295f8b34-f641-4a04-91cb-c76c493e9cb4", "name": "network-vif-plugged", "status": "completed", "tag": "b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:07:35.538828 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-04add58f-e6ad-42cf-93b4-983c7b1e19d7 req-afd12a30-ed38-436d-998c-4cbd5d19cb42 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:35.539228 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-04add58f-e6ad-42cf-93b4-983c7b1e19d7 req-afd12a30-ed38-436d-998c-4cbd5d19cb42 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:35.550036 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-04add58f-e6ad-42cf-93b4-983c7b1e19d7 req-afd12a30-ed38-436d-998c-4cbd5d19cb42 service nova] Creating event network-vif-plugged:b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1 for instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 on hv-cinder-83587 Jul 15 16:07:35.555066 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-04add58f-e6ad-42cf-93b4-983c7b1e19d7 req-afd12a30-ed38-436d-998c-4cbd5d19cb42 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028671 Jul 15 16:07:35.555860 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 612/1227] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:07:36.392791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-379c8875-b627-4804-a2e6-4f4070139856 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:36.393405 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-379c8875-b627-4804-a2e6-4f4070139856 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:36.399931 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-379c8875-b627-4804-a2e6-4f4070139856 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:36.400383 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-379c8875-b627-4804-a2e6-4f4070139856 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:36.401187 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-379c8875-b627-4804-a2e6-4f4070139856 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:36.401622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-379c8875-b627-4804-a2e6-4f4070139856 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:36.535088 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-379c8875-b627-4804-a2e6-4f4070139856 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:36.538901 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-379c8875-b627-4804-a2e6-4f4070139856 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.150647 Jul 15 16:07:36.539494 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 616/1228] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:36 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:37.557149 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-770382e5-de33-4423-83d9-a3bda8bd0812 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:37.557758 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-770382e5-de33-4423-83d9-a3bda8bd0812 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:37.564751 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-770382e5-de33-4423-83d9-a3bda8bd0812 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:37.565196 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-770382e5-de33-4423-83d9-a3bda8bd0812 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:37.565965 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-770382e5-de33-4423-83d9-a3bda8bd0812 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:37.566398 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-770382e5-de33-4423-83d9-a3bda8bd0812 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:37.704944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-770382e5-de33-4423-83d9-a3bda8bd0812 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:37.712353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-770382e5-de33-4423-83d9-a3bda8bd0812 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1260 microversion: 2.1 time: 0.159968 Jul 15 16:07:37.712918 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 613/1229] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:37 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:38.729106 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b815de7d-94ff-4ee2-a87b-aefce89d2d48 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:38.729716 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b815de7d-94ff-4ee2-a87b-aefce89d2d48 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:38.736311 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b815de7d-94ff-4ee2-a87b-aefce89d2d48 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:38.736757 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b815de7d-94ff-4ee2-a87b-aefce89d2d48 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:38.737513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b815de7d-94ff-4ee2-a87b-aefce89d2d48 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:38.737952 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b815de7d-94ff-4ee2-a87b-aefce89d2d48 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:38.869425 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b815de7d-94ff-4ee2-a87b-aefce89d2d48 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:38.876814 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b815de7d-94ff-4ee2-a87b-aefce89d2d48 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1443 microversion: 2.1 time: 0.151572 Jul 15 16:07:38.877380 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 617/1230] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:38 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:38.893293 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7ea3f2c8-1329-414b-a374-c6f713b954ce tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:07:38.893921 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7ea3f2c8-1329-414b-a374-c6f713b954ce tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:07:38.900453 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7ea3f2c8-1329-414b-a374-c6f713b954ce tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:38.900908 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7ea3f2c8-1329-414b-a374-c6f713b954ce tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:38.901675 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7ea3f2c8-1329-414b-a374-c6f713b954ce tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:38.902117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7ea3f2c8-1329-414b-a374-c6f713b954ce tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:39.034740 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7ea3f2c8-1329-414b-a374-c6f713b954ce tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:07:39.042497 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7ea3f2c8-1329-414b-a374-c6f713b954ce tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1443 microversion: 2.1 time: 0.153580 Jul 15 16:07:39.043073 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 614/1231] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:07:38 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:07:41.142784 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-852804d9-75f0-4471-881b-f902b6b38829 req-c5ed3a06-8f90-4f44-888b-56cbbae7065e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295f8b34-f641-4a04-91cb-c76c493e9cb4", "tag": "b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:07:41.152129 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-852804d9-75f0-4471-881b-f902b6b38829 req-c5ed3a06-8f90-4f44-888b-56cbbae7065e service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:07:41.152598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-852804d9-75f0-4471-881b-f902b6b38829 req-c5ed3a06-8f90-4f44-888b-56cbbae7065e service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:07:41.164841 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-852804d9-75f0-4471-881b-f902b6b38829 req-c5ed3a06-8f90-4f44-888b-56cbbae7065e service nova] Creating event network-changed:b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1 for instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 on hv-cinder-83587 Jul 15 16:07:41.170130 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-852804d9-75f0-4471-881b-f902b6b38829 req-c5ed3a06-8f90-4f44-888b-56cbbae7065e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031479 Jul 15 16:07:41.170751 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 618/1232] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:09:47.631801 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=7 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:09:47.632592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=25 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:09:47.636481 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:47.636978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:47.642736 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:47.643591 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:47.644000 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:47.644439 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:47.672215 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:09:47.899306 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [f153646d-cb5d-47c1-a9e8-1d4af00722f3] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 16:09:47.908834 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76a18289-1e08-4ac1-a9d4-e35f88ac1b76] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 15 16:09:48.905940 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [f153646d-cb5d-47c1-a9e8-1d4af00722f3] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 37306. Jul 15 16:09:48.921529 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] [76a18289-1e08-4ac1-a9d4-e35f88ac1b76] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 37308. Jul 15 16:09:49.051161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8c1d5b08-82cb-44f1-ba16-f6a6577e08ae tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "DELETE /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 204 len: 0 microversion: 2.1 time: 1.421143 Jul 15 16:09:49.051790 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 615/1233] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:09:47 2022] DELETE /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 0 bytes in 1423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:09:49.058111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=7 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:09:49.059368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=31 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:09:49.062857 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-f98b2f81-913f-466c-bf9b-5f7118a30806 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:49.063584 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-f98b2f81-913f-466c-bf9b-5f7118a30806 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:49.070371 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f98b2f81-913f-466c-bf9b-5f7118a30806 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:49.070879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f98b2f81-913f-466c-bf9b-5f7118a30806 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:49.071741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f98b2f81-913f-466c-bf9b-5f7118a30806 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:49.072182 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-f98b2f81-913f-466c-bf9b-5f7118a30806 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:49.320581 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-f98b2f81-913f-466c-bf9b-5f7118a30806 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:49.328305 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-f98b2f81-913f-466c-bf9b-5f7118a30806 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1578 microversion: 2.1 time: 0.272143 Jul 15 16:09:49.328866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 619/1234] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:49 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1578 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:50.345946 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bd4b6277-7c74-45e9-884e-b030bae9ff32 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:50.346652 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bd4b6277-7c74-45e9-884e-b030bae9ff32 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:50.355239 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd4b6277-7c74-45e9-884e-b030bae9ff32 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:50.355719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd4b6277-7c74-45e9-884e-b030bae9ff32 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:50.356714 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd4b6277-7c74-45e9-884e-b030bae9ff32 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:50.357165 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd4b6277-7c74-45e9-884e-b030bae9ff32 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:50.542648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bd4b6277-7c74-45e9-884e-b030bae9ff32 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:50.550719 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bd4b6277-7c74-45e9-884e-b030bae9ff32 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1578 microversion: 2.1 time: 0.209036 Jul 15 16:09:50.551287 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 616/1235] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:50 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:51.568102 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0ae888df-13de-475e-a862-09374a948a2e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:51.568713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0ae888df-13de-475e-a862-09374a948a2e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:51.576610 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0ae888df-13de-475e-a862-09374a948a2e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:51.577058 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0ae888df-13de-475e-a862-09374a948a2e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:51.577825 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0ae888df-13de-475e-a862-09374a948a2e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:51.578262 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0ae888df-13de-475e-a862-09374a948a2e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:51.641569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0ae888df-13de-475e-a862-09374a948a2e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:51.649782 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0ae888df-13de-475e-a862-09374a948a2e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1511 microversion: 2.1 time: 0.085997 Jul 15 16:09:51.650344 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 620/1236] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:51 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:51.828352 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-69fa3a5b-f073-4925-8d9e-c30500b6c162 req-cdcd1d8f-115a-4348-9e62-42430bed64f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "418c00e7-672a-4442-95e9-042c560955ff", "name": "network-vif-deleted", "tag": "e0c4457c-67c3-4bf6-8c60-587641b47e7f"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:09:51.837378 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-69fa3a5b-f073-4925-8d9e-c30500b6c162 req-cdcd1d8f-115a-4348-9e62-42430bed64f2 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:51.837947 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-69fa3a5b-f073-4925-8d9e-c30500b6c162 req-cdcd1d8f-115a-4348-9e62-42430bed64f2 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:51.849299 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-69fa3a5b-f073-4925-8d9e-c30500b6c162 req-cdcd1d8f-115a-4348-9e62-42430bed64f2 service nova] Creating event network-vif-deleted:e0c4457c-67c3-4bf6-8c60-587641b47e7f for instance 418c00e7-672a-4442-95e9-042c560955ff on hv-cinder-83587 Jul 15 16:09:51.860218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-69fa3a5b-f073-4925-8d9e-c30500b6c162 req-cdcd1d8f-115a-4348-9e62-42430bed64f2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030437 Jul 15 16:09:51.860218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 617/1237] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:09:52.666290 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:52.671610 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:52.673720 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:52.674175 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:52.674954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:52.675915 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:52.707452 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:52.707910 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:52.708386 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lazy-loading 'fault' on Instance uuid 418c00e7-672a-4442-95e9-042c560955ff {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:09:52.749233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:52.758389 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8739f476-8ef9-45ba-b576-fdddc0482fa0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 200 len: 1231 microversion: 2.1 time: 0.095837 Jul 15 16:09:52.759361 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 621/1238] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:52 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:53.777198 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:53.777925 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:53.785886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:53.786387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:53.787188 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:53.787651 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:53.801230 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] HTTP exception thrown: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Request method failure captured: Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff HTTP/1.1 Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0ZB8ig3-cilnd9jQ8TSt849jlWhSvfUwvMUQotyF5hwBzuNu9hGIi-XItaqQSJamjrznFqzspqIuR0WpAxpLa0HQkZbGeZLc1_zt4I-YzMPHZu8bAngsGZ94x5CWfpp-aTKANUo3V5WaNQJZkUrmA0Os0-SaVVN13rqzQEgNIWJ3hds Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:09:53.802821 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_801e210cf8c64e7184b178fbde47860c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-TestVolumeBootPattern-280606360 Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 14fecc08cd364a48a8640d522577aa39 Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:09:53.804572 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '418c00e7-672a-4442-95e9-042c560955ff'} Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:09:53.805605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:09:53.807445 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:09:53.809042 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Returning 404 to user: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:09:53.809042 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-63be3fcc-df7f-45e3-91f9-fc88d899da23 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 404 len: 111 microversion: 2.1 time: 0.031410 Jul 15 16:09:53.809042 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 618/1239] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:53 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:09:53.897379 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1932110468", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1496139757", "security_groups": [{"name": "tempest-secgroup-smoke-217764526"}], "block_device_mapping_v2": [{"uuid": "57ba7c1b-f257-43cd-9176-4eb120b0c00b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9dd76655-49f1-4b8f-9861-8e5cd93edef6"}]}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:09:54.005878 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.network.neutron [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] validate_networks() for [('9dd76655-49f1-4b8f-9861-8e5cd93edef6', None, None, None, None, None)] {{(pid=130091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:09:54.467004 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Flavor limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:09:54.467478 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Image limits 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:09:54.467949 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Flavor pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:09:54.468354 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Image pref 0:0:0 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:09:54.468789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.virt.hardware [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:09:54.478269 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:54.478711 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:54.479569 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:54.480006 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:54.496862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Getting quotas for project 801e210cf8c64e7184b178fbde47860c. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:09:54.500753 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.quota [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Getting quotas for user 14fecc08cd364a48a8640d522577aa39 and project 801e210cf8c64e7184b178fbde47860c. Resources: {'ram', 'cores', 'instances'} {{(pid=130091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:09:54.557174 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Going to run 1 instances... {{(pid=130091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:09:54.558750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57ba7c1b-f257-43cd-9176-4eb120b0c00b',volume_size=None,volume_type=None)] {{(pid=130091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:09:54.958517 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [7fefb0fa-8c20-4ca0-b63f-738e9de4dcca] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 16:09:55.965412 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [7fefb0fa-8c20-4ca0-b63f-738e9de4dcca] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 37350. Jul 15 16:09:55.969524 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-4fa3f425-b14c-4d6c-8337-5c126122fc53 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.076710 Jul 15 16:09:55.970219 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 622/1240] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:09:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 16:09:55.980081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8ba8affc-554a-4a78-81d0-c3d9f5c58568 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:55.980692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8ba8affc-554a-4a78-81d0-c3d9f5c58568 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:56.037475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8ba8affc-554a-4a78-81d0-c3d9f5c58568 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:56.045076 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8ba8affc-554a-4a78-81d0-c3d9f5c58568 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1095 microversion: 2.1 time: 0.068709 Jul 15 16:09:56.045648 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 619/1241] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:55 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:57.061288 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e0e1afce-2058-4612-bee4-c8e1a2a0eeca tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:57.061907 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e0e1afce-2058-4612-bee4-c8e1a2a0eeca tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:57.118420 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e0e1afce-2058-4612-bee4-c8e1a2a0eeca tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:57.125258 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e0e1afce-2058-4612-bee4-c8e1a2a0eeca tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1095 microversion: 2.1 time: 0.068457 Jul 15 16:09:57.125821 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 623/1242] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:57 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:58.142162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-62bd6601-6855-42b5-b679-3427c73296a5 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:58.142787 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-62bd6601-6855-42b5-b679-3427c73296a5 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:58.196629 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-62bd6601-6855-42b5-b679-3427c73296a5 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:58.203541 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-62bd6601-6855-42b5-b679-3427c73296a5 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1095 microversion: 2.1 time: 0.065233 Jul 15 16:09:58.204109 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 620/1243] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:58 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:58.473798 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-77af4ec0-672b-46a3-b4a6-b7ba76c000a2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:09:58.474407 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-77af4ec0-672b-46a3-b4a6-b7ba76c000a2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:58.482155 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-77af4ec0-672b-46a3-b4a6-b7ba76c000a2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:58.482602 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-77af4ec0-672b-46a3-b4a6-b7ba76c000a2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:58.483439 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-77af4ec0-672b-46a3-b4a6-b7ba76c000a2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:58.483874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-77af4ec0-672b-46a3-b4a6-b7ba76c000a2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:58.506197 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-77af4ec0-672b-46a3-b4a6-b7ba76c000a2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lazy-loading 'flavor' on Instance uuid 295f8b34-f641-4a04-91cb-c76c493e9cb4 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:09:58.775452 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-77af4ec0-672b-46a3-b4a6-b7ba76c000a2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "POST /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4/action" status: 202 len: 0 microversion: 2.1 time: 0.305768 Jul 15 16:09:58.775958 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 624/1244] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 16:09:58 2022] POST /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:09:58.784265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-87e63eca-dd64-4b10-9fd6-224f14fc91a8 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:58.785452 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-87e63eca-dd64-4b10-9fd6-224f14fc91a8 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:58.792448 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-87e63eca-dd64-4b10-9fd6-224f14fc91a8 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:58.792905 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-87e63eca-dd64-4b10-9fd6-224f14fc91a8 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:58.793710 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-87e63eca-dd64-4b10-9fd6-224f14fc91a8 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:58.794201 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-87e63eca-dd64-4b10-9fd6-224f14fc91a8 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:58.926691 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-87e63eca-dd64-4b10-9fd6-224f14fc91a8 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:58.934357 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-87e63eca-dd64-4b10-9fd6-224f14fc91a8 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.154080 Jul 15 16:09:58.934922 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 621/1245] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:58 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:59.220830 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e732490e-0f4a-430a-8b12-15886a6ad25a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:59.221540 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e732490e-0f4a-430a-8b12-15886a6ad25a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:59.274222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e732490e-0f4a-430a-8b12-15886a6ad25a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:09:59.280950 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e732490e-0f4a-430a-8b12-15886a6ad25a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1095 microversion: 2.1 time: 0.064337 Jul 15 16:09:59.281547 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 625/1246] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:59 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:09:59.952079 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a62fd216-dc4a-4d23-8c01-3376b34cdf3c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:09:59.952695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a62fd216-dc4a-4d23-8c01-3376b34cdf3c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:09:59.959850 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a62fd216-dc4a-4d23-8c01-3376b34cdf3c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:59.960602 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a62fd216-dc4a-4d23-8c01-3376b34cdf3c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:09:59.961054 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a62fd216-dc4a-4d23-8c01-3376b34cdf3c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:09:59.961490 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a62fd216-dc4a-4d23-8c01-3376b34cdf3c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:00.095962 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a62fd216-dc4a-4d23-8c01-3376b34cdf3c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:00.103958 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a62fd216-dc4a-4d23-8c01-3376b34cdf3c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.155800 Jul 15 16:10:00.104550 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 622/1247] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:09:59 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:00.297552 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-664bc9b3-ac8a-4f68-ad15-a3723d745690 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:00.298184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-664bc9b3-ac8a-4f68-ad15-a3723d745690 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:00.306157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-664bc9b3-ac8a-4f68-ad15-a3723d745690 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:00.306598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-664bc9b3-ac8a-4f68-ad15-a3723d745690 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:00.307388 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-664bc9b3-ac8a-4f68-ad15-a3723d745690 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:00.307828 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-664bc9b3-ac8a-4f68-ad15-a3723d745690 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:00.368084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-664bc9b3-ac8a-4f68-ad15-a3723d745690 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:00.375316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-664bc9b3-ac8a-4f68-ad15-a3723d745690 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1145 microversion: 2.1 time: 0.081746 Jul 15 16:10:00.375954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 626/1248] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:00 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:01.121772 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-11393c89-f98a-418d-9ee0-1ea9587d1722 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:01.122508 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-11393c89-f98a-418d-9ee0-1ea9587d1722 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:01.129540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11393c89-f98a-418d-9ee0-1ea9587d1722 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:01.129994 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11393c89-f98a-418d-9ee0-1ea9587d1722 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:01.130780 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11393c89-f98a-418d-9ee0-1ea9587d1722 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:01.131204 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-11393c89-f98a-418d-9ee0-1ea9587d1722 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:01.274363 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-11393c89-f98a-418d-9ee0-1ea9587d1722 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:01.282078 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-11393c89-f98a-418d-9ee0-1ea9587d1722 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.164242 Jul 15 16:10:01.282643 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 623/1249] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:01 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:01.391833 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-24ef896d-a73b-47d5-ad7b-bcc0c8447438 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:01.392408 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-24ef896d-a73b-47d5-ad7b-bcc0c8447438 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:01.399501 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-24ef896d-a73b-47d5-ad7b-bcc0c8447438 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:01.399954 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-24ef896d-a73b-47d5-ad7b-bcc0c8447438 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:01.400732 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-24ef896d-a73b-47d5-ad7b-bcc0c8447438 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:01.401172 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-24ef896d-a73b-47d5-ad7b-bcc0c8447438 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:01.462131 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-24ef896d-a73b-47d5-ad7b-bcc0c8447438 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:01.471576 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-24ef896d-a73b-47d5-ad7b-bcc0c8447438 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1137 microversion: 2.1 time: 0.083663 Jul 15 16:10:01.472192 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 627/1250] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:01 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:02.298147 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-438626bf-877f-4b7b-9413-60bfd549a17d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:02.298751 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-438626bf-877f-4b7b-9413-60bfd549a17d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:02.305638 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-438626bf-877f-4b7b-9413-60bfd549a17d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:02.306144 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-438626bf-877f-4b7b-9413-60bfd549a17d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:02.306983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-438626bf-877f-4b7b-9413-60bfd549a17d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:02.307461 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-438626bf-877f-4b7b-9413-60bfd549a17d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:02.460801 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-438626bf-877f-4b7b-9413-60bfd549a17d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:02.468903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-438626bf-877f-4b7b-9413-60bfd549a17d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.174538 Jul 15 16:10:02.469485 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 624/1251] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:02 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:02.488847 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-18a0e084-5253-408f-b617-31161ded7c89 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:02.489484 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-18a0e084-5253-408f-b617-31161ded7c89 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:02.496377 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-18a0e084-5253-408f-b617-31161ded7c89 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:02.496883 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-18a0e084-5253-408f-b617-31161ded7c89 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:02.497626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-18a0e084-5253-408f-b617-31161ded7c89 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:02.498066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-18a0e084-5253-408f-b617-31161ded7c89 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:02.571696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-18a0e084-5253-408f-b617-31161ded7c89 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:02.579450 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-18a0e084-5253-408f-b617-31161ded7c89 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1211 microversion: 2.1 time: 0.094524 Jul 15 16:10:02.594403 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 628/1252] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:02 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:03.486784 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9181c542-1a31-4e23-9f6e-9c5df84d6ef3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:03.487435 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9181c542-1a31-4e23-9f6e-9c5df84d6ef3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:03.494620 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9181c542-1a31-4e23-9f6e-9c5df84d6ef3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:03.499627 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9181c542-1a31-4e23-9f6e-9c5df84d6ef3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:03.499627 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9181c542-1a31-4e23-9f6e-9c5df84d6ef3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:03.499627 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9181c542-1a31-4e23-9f6e-9c5df84d6ef3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:03.599066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1ede0805-91d4-4d61-b18f-ea4e5670a997 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:03.600820 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1ede0805-91d4-4d61-b18f-ea4e5670a997 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:03.608497 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ede0805-91d4-4d61-b18f-ea4e5670a997 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:03.609800 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ede0805-91d4-4d61-b18f-ea4e5670a997 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:03.609800 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ede0805-91d4-4d61-b18f-ea4e5670a997 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:03.610151 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1ede0805-91d4-4d61-b18f-ea4e5670a997 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:03.741295 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9181c542-1a31-4e23-9f6e-9c5df84d6ef3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:03.752815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9181c542-1a31-4e23-9f6e-9c5df84d6ef3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.269782 Jul 15 16:10:03.757486 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 625/1253] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:03 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:03.786913 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1ede0805-91d4-4d61-b18f-ea4e5670a997 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:03.794669 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1ede0805-91d4-4d61-b18f-ea4e5670a997 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1278 microversion: 2.1 time: 0.200284 Jul 15 16:10:03.795248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 629/1254] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:03 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:04.041134 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-8053261b-9a64-4ffd-a0fc-fa23aa71109a req-5dbf89db-baa1-4fdc-9bcc-5c3b1733a893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a23251-1065-4120-9225-0355fffc3b7a", "tag": "6dd32f5a-add9-40f0-b846-e0e4e904c4a3"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:10:04.048166 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-8053261b-9a64-4ffd-a0fc-fa23aa71109a req-5dbf89db-baa1-4fdc-9bcc-5c3b1733a893 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:04.048614 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-8053261b-9a64-4ffd-a0fc-fa23aa71109a req-5dbf89db-baa1-4fdc-9bcc-5c3b1733a893 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:04.060209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-8053261b-9a64-4ffd-a0fc-fa23aa71109a req-5dbf89db-baa1-4fdc-9bcc-5c3b1733a893 service nova] Creating event network-changed:6dd32f5a-add9-40f0-b846-e0e4e904c4a3 for instance 15a23251-1065-4120-9225-0355fffc3b7a on hv-cinder-83587 Jul 15 16:10:04.065349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-8053261b-9a64-4ffd-a0fc-fa23aa71109a req-5dbf89db-baa1-4fdc-9bcc-5c3b1733a893 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105133 Jul 15 16:10:04.066058 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 626/1255] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:10:04.773981 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-156c31a3-bcc4-434d-9127-b78c65b02af9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:04.774600 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-156c31a3-bcc4-434d-9127-b78c65b02af9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:04.776624 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:10:04.781869 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-156c31a3-bcc4-434d-9127-b78c65b02af9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:04.782319 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-156c31a3-bcc4-434d-9127-b78c65b02af9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:04.783095 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-156c31a3-bcc4-434d-9127-b78c65b02af9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:04.783564 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-156c31a3-bcc4-434d-9127-b78c65b02af9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:04.811929 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-38ce0059-907b-4c17-b310-ecdaff7ea701 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:04.812758 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-38ce0059-907b-4c17-b310-ecdaff7ea701 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:04.821056 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38ce0059-907b-4c17-b310-ecdaff7ea701 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:04.821514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38ce0059-907b-4c17-b310-ecdaff7ea701 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:04.822300 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38ce0059-907b-4c17-b310-ecdaff7ea701 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:04.823000 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-38ce0059-907b-4c17-b310-ecdaff7ea701 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:04.919256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-156c31a3-bcc4-434d-9127-b78c65b02af9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:04.927033 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-156c31a3-bcc4-434d-9127-b78c65b02af9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.156824 Jul 15 16:10:04.927636 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 630/1256] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:04 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:04.959374 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-38ce0059-907b-4c17-b310-ecdaff7ea701 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:04.966852 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-38ce0059-907b-4c17-b310-ecdaff7ea701 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.159667 Jul 15 16:10:04.967475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 627/1257] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:04 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:05.944086 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-505d59ea-83a3-4d2b-854c-3be37cf08c9e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:05.944628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-505d59ea-83a3-4d2b-854c-3be37cf08c9e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:05.951092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-505d59ea-83a3-4d2b-854c-3be37cf08c9e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:05.951565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-505d59ea-83a3-4d2b-854c-3be37cf08c9e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:05.952331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-505d59ea-83a3-4d2b-854c-3be37cf08c9e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:05.952766 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-505d59ea-83a3-4d2b-854c-3be37cf08c9e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:05.982983 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a6313ec4-db1d-46e9-b9b6-9b6a1c5f3349 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:05.983630 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a6313ec4-db1d-46e9-b9b6-9b6a1c5f3349 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:05.990955 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a6313ec4-db1d-46e9-b9b6-9b6a1c5f3349 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:05.991440 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a6313ec4-db1d-46e9-b9b6-9b6a1c5f3349 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:05.992225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a6313ec4-db1d-46e9-b9b6-9b6a1c5f3349 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:05.992668 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a6313ec4-db1d-46e9-b9b6-9b6a1c5f3349 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:06.087664 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-505d59ea-83a3-4d2b-854c-3be37cf08c9e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:06.095284 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-505d59ea-83a3-4d2b-854c-3be37cf08c9e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.155076 Jul 15 16:10:06.095874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 631/1258] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:05 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:06.127002 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a6313ec4-db1d-46e9-b9b6-9b6a1c5f3349 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:06.134501 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a6313ec4-db1d-46e9-b9b6-9b6a1c5f3349 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.155358 Jul 15 16:10:06.135069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 628/1259] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:05 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:07.113557 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fde24dea-cbdc-47e0-8f39-8db927b5f215 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:07.114253 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fde24dea-cbdc-47e0-8f39-8db927b5f215 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:07.120718 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fde24dea-cbdc-47e0-8f39-8db927b5f215 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:07.121249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fde24dea-cbdc-47e0-8f39-8db927b5f215 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:07.122024 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fde24dea-cbdc-47e0-8f39-8db927b5f215 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:07.122469 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fde24dea-cbdc-47e0-8f39-8db927b5f215 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:07.150900 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-bd658dc8-9e63-4fbf-bdf3-fb7f5226744a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:07.151571 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-bd658dc8-9e63-4fbf-bdf3-fb7f5226744a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:07.158436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd658dc8-9e63-4fbf-bdf3-fb7f5226744a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:07.158895 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd658dc8-9e63-4fbf-bdf3-fb7f5226744a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:07.160236 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd658dc8-9e63-4fbf-bdf3-fb7f5226744a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:07.160683 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-bd658dc8-9e63-4fbf-bdf3-fb7f5226744a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:07.252616 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-fde24dea-cbdc-47e0-8f39-8db927b5f215 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:07.260094 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fde24dea-cbdc-47e0-8f39-8db927b5f215 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.151096 Jul 15 16:10:07.261108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 632/1260] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:07 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:07.290839 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-bd658dc8-9e63-4fbf-bdf3-fb7f5226744a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:07.298447 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-bd658dc8-9e63-4fbf-bdf3-fb7f5226744a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.151314 Jul 15 16:10:07.299027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 629/1261] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:07 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:08.276521 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b34e834b-1d23-4fe6-8b41-da0b095edd0e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:08.277136 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b34e834b-1d23-4fe6-8b41-da0b095edd0e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:08.283631 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b34e834b-1d23-4fe6-8b41-da0b095edd0e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:08.284084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b34e834b-1d23-4fe6-8b41-da0b095edd0e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:08.284855 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b34e834b-1d23-4fe6-8b41-da0b095edd0e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:08.285288 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b34e834b-1d23-4fe6-8b41-da0b095edd0e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:08.315951 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-a21259e4-2882-4ee5-bb5d-7b23fb7655bc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:08.316723 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-a21259e4-2882-4ee5-bb5d-7b23fb7655bc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:08.319224 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=4 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:10:08.325077 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a21259e4-2882-4ee5-bb5d-7b23fb7655bc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:08.325540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a21259e4-2882-4ee5-bb5d-7b23fb7655bc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:08.326335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a21259e4-2882-4ee5-bb5d-7b23fb7655bc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:08.326808 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-a21259e4-2882-4ee5-bb5d-7b23fb7655bc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:08.427943 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b34e834b-1d23-4fe6-8b41-da0b095edd0e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:08.435677 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b34e834b-1d23-4fe6-8b41-da0b095edd0e tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.162949 Jul 15 16:10:08.436248 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 633/1262] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:08 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:08.463205 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-a21259e4-2882-4ee5-bb5d-7b23fb7655bc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:08.471569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-a21259e4-2882-4ee5-bb5d-7b23fb7655bc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.158746 Jul 15 16:10:08.471569 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 630/1263] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:08 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:08.514498 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:10:08.514658 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:10:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:10:09.453208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-65311f0c-f669-4299-bf8e-b5f0eff1b90b tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:09.453830 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-65311f0c-f669-4299-bf8e-b5f0eff1b90b tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:09.455747 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=10 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:10:09.461039 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-65311f0c-f669-4299-bf8e-b5f0eff1b90b tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:09.461496 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-65311f0c-f669-4299-bf8e-b5f0eff1b90b tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:09.462272 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-65311f0c-f669-4299-bf8e-b5f0eff1b90b tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:09.462714 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-65311f0c-f669-4299-bf8e-b5f0eff1b90b tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:09.489178 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-656ac1c5-bd47-4504-8cb5-b3063ddf549b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:09.489791 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-656ac1c5-bd47-4504-8cb5-b3063ddf549b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:09.498218 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-656ac1c5-bd47-4504-8cb5-b3063ddf549b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:09.498666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-656ac1c5-bd47-4504-8cb5-b3063ddf549b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:09.499468 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-656ac1c5-bd47-4504-8cb5-b3063ddf549b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:09.500006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-656ac1c5-bd47-4504-8cb5-b3063ddf549b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:09.596469 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-65311f0c-f669-4299-bf8e-b5f0eff1b90b tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:09.604914 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-65311f0c-f669-4299-bf8e-b5f0eff1b90b tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.155561 Jul 15 16:10:09.605492 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 634/1264] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:09 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:09.678761 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-656ac1c5-bd47-4504-8cb5-b3063ddf549b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:09.686323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-656ac1c5-bd47-4504-8cb5-b3063ddf549b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.202487 Jul 15 16:10:09.686886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 631/1265] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:09 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:10.621934 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-71c49041-d6ed-448d-9d9d-9ef5700631a9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:10.622542 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-71c49041-d6ed-448d-9d9d-9ef5700631a9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:10.629642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-71c49041-d6ed-448d-9d9d-9ef5700631a9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:10.630085 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-71c49041-d6ed-448d-9d9d-9ef5700631a9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:10.630908 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-71c49041-d6ed-448d-9d9d-9ef5700631a9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:10.631357 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-71c49041-d6ed-448d-9d9d-9ef5700631a9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:10.702380 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fbb3015a-abdd-4f1b-a77f-8748783a9161 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:10.703132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fbb3015a-abdd-4f1b-a77f-8748783a9161 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:10.710274 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbb3015a-abdd-4f1b-a77f-8748783a9161 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:10.710850 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbb3015a-abdd-4f1b-a77f-8748783a9161 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:10.716027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbb3015a-abdd-4f1b-a77f-8748783a9161 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:10.716027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fbb3015a-abdd-4f1b-a77f-8748783a9161 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:10.770565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-71c49041-d6ed-448d-9d9d-9ef5700631a9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:10.774020 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:10:10.778473 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-71c49041-d6ed-448d-9d9d-9ef5700631a9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.160372 Jul 15 16:10:10.779042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 635/1266] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:10 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:10.843382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fbb3015a-abdd-4f1b-a77f-8748783a9161 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:10.851632 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fbb3015a-abdd-4f1b-a77f-8748783a9161 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.153255 Jul 15 16:10:10.852388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 632/1267] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:10 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:11.796506 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-75859980-f691-4186-95c5-74ae54148198 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:11.797212 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-75859980-f691-4186-95c5-74ae54148198 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:11.804859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75859980-f691-4186-95c5-74ae54148198 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:11.805316 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75859980-f691-4186-95c5-74ae54148198 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:11.806089 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75859980-f691-4186-95c5-74ae54148198 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:11.806532 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-75859980-f691-4186-95c5-74ae54148198 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:11.868430 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9e320771-39da-4688-a5c2-802ef5d8d1bf tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:11.869053 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9e320771-39da-4688-a5c2-802ef5d8d1bf tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:11.875695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e320771-39da-4688-a5c2-802ef5d8d1bf tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:11.876154 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e320771-39da-4688-a5c2-802ef5d8d1bf tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:11.876945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e320771-39da-4688-a5c2-802ef5d8d1bf tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:11.877387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e320771-39da-4688-a5c2-802ef5d8d1bf tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:11.949346 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-75859980-f691-4186-95c5-74ae54148198 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:11.957712 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-75859980-f691-4186-95c5-74ae54148198 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.165503 Jul 15 16:10:11.958948 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 636/1268] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:11 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:12.014733 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9e320771-39da-4688-a5c2-802ef5d8d1bf tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:12.018169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:10:12.023084 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9e320771-39da-4688-a5c2-802ef5d8d1bf tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.158647 Jul 15 16:10:12.023682 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 633/1269] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:11 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:12.974956 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0691f5ef-264b-45ce-ab32-28c8ef6db0d2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:12.975870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0691f5ef-264b-45ce-ab32-28c8ef6db0d2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:12.982523 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0691f5ef-264b-45ce-ab32-28c8ef6db0d2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:12.982972 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0691f5ef-264b-45ce-ab32-28c8ef6db0d2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:12.984041 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0691f5ef-264b-45ce-ab32-28c8ef6db0d2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:12.984472 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0691f5ef-264b-45ce-ab32-28c8ef6db0d2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:13.042605 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ccafccf0-b451-4cb2-961a-b563eb7bf130 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:13.043225 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ccafccf0-b451-4cb2-961a-b563eb7bf130 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:13.052068 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ccafccf0-b451-4cb2-961a-b563eb7bf130 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:13.053003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ccafccf0-b451-4cb2-961a-b563eb7bf130 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:13.053971 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ccafccf0-b451-4cb2-961a-b563eb7bf130 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:13.054676 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ccafccf0-b451-4cb2-961a-b563eb7bf130 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:13.120246 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0691f5ef-264b-45ce-ab32-28c8ef6db0d2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:13.128112 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0691f5ef-264b-45ce-ab32-28c8ef6db0d2 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1568 microversion: 2.1 time: 0.157809 Jul 15 16:10:13.129338 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 637/1270] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:12 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:13.145763 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-fa9e1094-23c3-4950-a84f-0373e96872c9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:10:13.148619 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-fa9e1094-23c3-4950-a84f-0373e96872c9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:13.152778 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa9e1094-23c3-4950-a84f-0373e96872c9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:13.153243 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa9e1094-23c3-4950-a84f-0373e96872c9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:13.154032 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa9e1094-23c3-4950-a84f-0373e96872c9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:13.154474 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-fa9e1094-23c3-4950-a84f-0373e96872c9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:13.196031 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ccafccf0-b451-4cb2-961a-b563eb7bf130 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:13.203837 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ccafccf0-b451-4cb2-961a-b563eb7bf130 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.165366 Jul 15 16:10:13.204436 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 634/1271] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:13 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:10:13.333465 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-fa9e1094-23c3-4950-a84f-0373e96872c9 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "POST /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4/action" status: 202 len: 0 microversion: 2.1 time: 0.191959 Jul 15 16:10:13.334646 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 638/1272] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Jul 15 16:10:13 2022] POST /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 16:10:13.342754 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fe1c0485-c233-4bb2-888d-42e82c593780 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:13.343401 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fe1c0485-c233-4bb2-888d-42e82c593780 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:13.350006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe1c0485-c233-4bb2-888d-42e82c593780 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:13.350726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe1c0485-c233-4bb2-888d-42e82c593780 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:13.351559 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe1c0485-c233-4bb2-888d-42e82c593780 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:13.352038 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fe1c0485-c233-4bb2-888d-42e82c593780 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:13.748969 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fe1c0485-c233-4bb2-888d-42e82c593780 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:13.757332 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fe1c0485-c233-4bb2-888d-42e82c593780 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1576 microversion: 2.1 time: 0.418929 Jul 15 16:10:13.757976 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 635/1273] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:13 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1576 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:14.221066 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e8f3559c-fe3b-4d9e-8da7-5c69f25f55c3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:14.221687 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e8f3559c-fe3b-4d9e-8da7-5c69f25f55c3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:14.228137 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8f3559c-fe3b-4d9e-8da7-5c69f25f55c3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:14.228573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8f3559c-fe3b-4d9e-8da7-5c69f25f55c3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:14.229349 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8f3559c-fe3b-4d9e-8da7-5c69f25f55c3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:14.229789 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e8f3559c-fe3b-4d9e-8da7-5c69f25f55c3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:14.375862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e8f3559c-fe3b-4d9e-8da7-5c69f25f55c3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:14.384355 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e8f3559c-fe3b-4d9e-8da7-5c69f25f55c3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.167600 Jul 15 16:10:14.385299 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 639/1274] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:14 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:14.400578 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-9d943f4e-d4d7-494f-8d28-643a44679c0f req-44f044d7-49c2-47ae-bac2-d3f955b4d427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a23251-1065-4120-9225-0355fffc3b7a", "name": "network-vif-plugged", "status": "completed", "tag": "6dd32f5a-add9-40f0-b846-e0e4e904c4a3"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:10:14.408877 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-9d943f4e-d4d7-494f-8d28-643a44679c0f req-44f044d7-49c2-47ae-bac2-d3f955b4d427 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:14.409320 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-9d943f4e-d4d7-494f-8d28-643a44679c0f req-44f044d7-49c2-47ae-bac2-d3f955b4d427 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:14.420382 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-9d943f4e-d4d7-494f-8d28-643a44679c0f req-44f044d7-49c2-47ae-bac2-d3f955b4d427 service nova] Creating event network-vif-plugged:6dd32f5a-add9-40f0-b846-e0e4e904c4a3 for instance 15a23251-1065-4120-9225-0355fffc3b7a on hv-cinder-83587 Jul 15 16:10:14.426009 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-9d943f4e-d4d7-494f-8d28-643a44679c0f req-44f044d7-49c2-47ae-bac2-d3f955b4d427 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092192 Jul 15 16:10:14.426561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 636/1275] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:10:14.773930 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-b9b93238-7070-4414-8ec5-8f738095f829 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:14.774655 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-b9b93238-7070-4414-8ec5-8f738095f829 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:14.780975 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b9b93238-7070-4414-8ec5-8f738095f829 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:14.781424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b9b93238-7070-4414-8ec5-8f738095f829 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:14.782193 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b9b93238-7070-4414-8ec5-8f738095f829 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:14.782621 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-b9b93238-7070-4414-8ec5-8f738095f829 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:14.925709 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-b9b93238-7070-4414-8ec5-8f738095f829 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:14.934127 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-b9b93238-7070-4414-8ec5-8f738095f829 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1518 microversion: 2.1 time: 0.163994 Jul 15 16:10:14.934698 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 640/1276] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:14 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:15.402395 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-7c808a39-6b07-4d1b-9d47-5bd1907d92d7 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:15.403092 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-7c808a39-6b07-4d1b-9d47-5bd1907d92d7 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:15.409365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7c808a39-6b07-4d1b-9d47-5bd1907d92d7 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:15.409816 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7c808a39-6b07-4d1b-9d47-5bd1907d92d7 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:15.410637 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7c808a39-6b07-4d1b-9d47-5bd1907d92d7 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:15.411076 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-7c808a39-6b07-4d1b-9d47-5bd1907d92d7 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:15.552522 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-7c808a39-6b07-4d1b-9d47-5bd1907d92d7 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:15.560117 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-7c808a39-6b07-4d1b-9d47-5bd1907d92d7 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1266 microversion: 2.1 time: 0.162393 Jul 15 16:10:15.560684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 637/1277] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:15 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:15.951385 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-223092d6-3de0-4c0b-82ba-58bacda32832 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:15.952002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-223092d6-3de0-4c0b-82ba-58bacda32832 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:15.958667 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-223092d6-3de0-4c0b-82ba-58bacda32832 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:15.959117 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-223092d6-3de0-4c0b-82ba-58bacda32832 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:15.959924 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-223092d6-3de0-4c0b-82ba-58bacda32832 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:15.960363 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-223092d6-3de0-4c0b-82ba-58bacda32832 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:16.108805 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-223092d6-3de0-4c0b-82ba-58bacda32832 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:16.117565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-223092d6-3de0-4c0b-82ba-58bacda32832 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1518 microversion: 2.1 time: 0.169976 Jul 15 16:10:16.118148 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 641/1278] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:15 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:16.440613 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-fce07741-d701-42ef-9ea3-94da88736f1c req-d6a31396-2e9e-4731-853a-2fd38ac31eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295f8b34-f641-4a04-91cb-c76c493e9cb4", "name": "network-vif-unplugged", "status": "completed", "tag": "b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:10:16.450122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-fce07741-d701-42ef-9ea3-94da88736f1c req-d6a31396-2e9e-4731-853a-2fd38ac31eba service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:16.450122 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-fce07741-d701-42ef-9ea3-94da88736f1c req-d6a31396-2e9e-4731-853a-2fd38ac31eba service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:16.460455 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.compute.server_external_events [req-fce07741-d701-42ef-9ea3-94da88736f1c req-d6a31396-2e9e-4731-853a-2fd38ac31eba service nova] Unable to find a host for instance 295f8b34-f641-4a04-91cb-c76c493e9cb4. Dropping event network-vif-unplugged {{(pid=130090) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 15 16:10:16.461441 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-fce07741-d701-42ef-9ea3-94da88736f1c req-d6a31396-2e9e-4731-853a-2fd38ac31eba service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024695 Jul 15 16:10:16.462009 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 638/1279] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 15 16:10:16.577334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8a8830bf-8404-4f9e-b48c-ae4db835e329 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:16.577985 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8a8830bf-8404-4f9e-b48c-ae4db835e329 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:16.584595 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8a8830bf-8404-4f9e-b48c-ae4db835e329 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:16.585052 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8a8830bf-8404-4f9e-b48c-ae4db835e329 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:16.585837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8a8830bf-8404-4f9e-b48c-ae4db835e329 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:16.586359 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8a8830bf-8404-4f9e-b48c-ae4db835e329 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:16.719906 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8a8830bf-8404-4f9e-b48c-ae4db835e329 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:16.728503 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8a8830bf-8404-4f9e-b48c-ae4db835e329 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1453 microversion: 2.1 time: 0.155035 Jul 15 16:10:16.729114 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 642/1280] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:16 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:16.744416 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-0e197b46-86a5-42ee-ad33-f2991d86cd3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:16.745034 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-0e197b46-86a5-42ee-ad33-f2991d86cd3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:16.750978 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0e197b46-86a5-42ee-ad33-f2991d86cd3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:16.751474 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0e197b46-86a5-42ee-ad33-f2991d86cd3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:16.752293 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0e197b46-86a5-42ee-ad33-f2991d86cd3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:16.752731 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-0e197b46-86a5-42ee-ad33-f2991d86cd3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:16.885461 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-0e197b46-86a5-42ee-ad33-f2991d86cd3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:16.893335 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-0e197b46-86a5-42ee-ad33-f2991d86cd3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1453 microversion: 2.1 time: 0.152773 Jul 15 16:10:16.893897 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 639/1281] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:16 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:17.134628 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e4f4b4a0-abec-45d9-8aa3-0df895178841 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:17.135239 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-e4f4b4a0-abec-45d9-8aa3-0df895178841 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:17.142074 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e4f4b4a0-abec-45d9-8aa3-0df895178841 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:17.142523 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e4f4b4a0-abec-45d9-8aa3-0df895178841 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:17.143312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e4f4b4a0-abec-45d9-8aa3-0df895178841 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:17.143763 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-e4f4b4a0-abec-45d9-8aa3-0df895178841 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:17.283611 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-e4f4b4a0-abec-45d9-8aa3-0df895178841 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:17.292510 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e4f4b4a0-abec-45d9-8aa3-0df895178841 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.161734 Jul 15 16:10:17.293196 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 643/1282] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:17 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:18.310148 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-087a88fb-e7c0-4b91-8567-ad382ac842e3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:18.310704 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-087a88fb-e7c0-4b91-8567-ad382ac842e3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:18.313130 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:10:18.319352 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-087a88fb-e7c0-4b91-8567-ad382ac842e3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:18.319806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-087a88fb-e7c0-4b91-8567-ad382ac842e3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:18.320587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-087a88fb-e7c0-4b91-8567-ad382ac842e3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:18.321109 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-087a88fb-e7c0-4b91-8567-ad382ac842e3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:18.525209 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-087a88fb-e7c0-4b91-8567-ad382ac842e3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:18.532887 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-087a88fb-e7c0-4b91-8567-ad382ac842e3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.226775 Jul 15 16:10:18.533670 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 640/1283] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:18 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:19.205734 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-5fd51801-e8b5-40aa-a3df-62ea67db8355 req-121e58f8-0fc5-419f-8e5c-c0537ff45f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a23251-1065-4120-9225-0355fffc3b7a", "tag": "6dd32f5a-add9-40f0-b846-e0e4e904c4a3"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:10:19.210268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:10:19.215434 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-5fd51801-e8b5-40aa-a3df-62ea67db8355 req-121e58f8-0fc5-419f-8e5c-c0537ff45f1c service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:19.215886 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-5fd51801-e8b5-40aa-a3df-62ea67db8355 req-121e58f8-0fc5-419f-8e5c-c0537ff45f1c service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:19.227225 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-5fd51801-e8b5-40aa-a3df-62ea67db8355 req-121e58f8-0fc5-419f-8e5c-c0537ff45f1c service nova] Creating event network-changed:6dd32f5a-add9-40f0-b846-e0e4e904c4a3 for instance 15a23251-1065-4120-9225-0355fffc3b7a on hv-cinder-83587 Jul 15 16:10:19.232279 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-5fd51801-e8b5-40aa-a3df-62ea67db8355 req-121e58f8-0fc5-419f-8e5c-c0537ff45f1c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030207 Jul 15 16:10:19.232925 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 644/1284] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:10:19.550199 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-252274dc-c6fd-432e-b2f3-7bab03d23081 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:19.551519 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-252274dc-c6fd-432e-b2f3-7bab03d23081 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:19.557886 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-252274dc-c6fd-432e-b2f3-7bab03d23081 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:19.558349 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-252274dc-c6fd-432e-b2f3-7bab03d23081 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:19.559130 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-252274dc-c6fd-432e-b2f3-7bab03d23081 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:19.559604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-252274dc-c6fd-432e-b2f3-7bab03d23081 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:19.778063 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-252274dc-c6fd-432e-b2f3-7bab03d23081 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:19.785621 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-252274dc-c6fd-432e-b2f3-7bab03d23081 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.239555 Jul 15 16:10:19.786195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 641/1285] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:19 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:20.803042 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-07bec6c5-24ee-4cc4-a97b-be7d203c447d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:20.803776 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-07bec6c5-24ee-4cc4-a97b-be7d203c447d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:20.810622 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07bec6c5-24ee-4cc4-a97b-be7d203c447d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:20.811070 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07bec6c5-24ee-4cc4-a97b-be7d203c447d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:20.811874 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07bec6c5-24ee-4cc4-a97b-be7d203c447d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:20.812309 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-07bec6c5-24ee-4cc4-a97b-be7d203c447d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:20.949008 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-07bec6c5-24ee-4cc4-a97b-be7d203c447d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:20.956443 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-07bec6c5-24ee-4cc4-a97b-be7d203c447d tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.158220 Jul 15 16:10:20.957565 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 645/1286] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:20 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:21.974666 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-eac4300d-3abc-4bba-bc87-179e36c279ea tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:21.975286 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-eac4300d-3abc-4bba-bc87-179e36c279ea tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:21.982053 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eac4300d-3abc-4bba-bc87-179e36c279ea tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:21.982504 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eac4300d-3abc-4bba-bc87-179e36c279ea tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:21.983265 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eac4300d-3abc-4bba-bc87-179e36c279ea tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:21.983729 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-eac4300d-3abc-4bba-bc87-179e36c279ea tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:22.116340 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-eac4300d-3abc-4bba-bc87-179e36c279ea tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:22.123875 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-eac4300d-3abc-4bba-bc87-179e36c279ea tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.153852 Jul 15 16:10:22.128213 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 642/1287] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:21 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:23.140579 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-8296a98c-9dc8-46a5-81db-84501efc10f4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:23.141194 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-8296a98c-9dc8-46a5-81db-84501efc10f4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:23.147781 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8296a98c-9dc8-46a5-81db-84501efc10f4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:23.148225 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8296a98c-9dc8-46a5-81db-84501efc10f4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:23.148984 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8296a98c-9dc8-46a5-81db-84501efc10f4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:23.149416 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-8296a98c-9dc8-46a5-81db-84501efc10f4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:23.278642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-8296a98c-9dc8-46a5-81db-84501efc10f4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:23.286707 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-8296a98c-9dc8-46a5-81db-84501efc10f4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.149923 Jul 15 16:10:23.287370 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 646/1288] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:23 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:24.309592 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-8f670444-8873-4103-a9bd-7aceb0cc15d3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:24.310207 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-8f670444-8873-4103-a9bd-7aceb0cc15d3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:24.317369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8f670444-8873-4103-a9bd-7aceb0cc15d3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:24.317813 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8f670444-8873-4103-a9bd-7aceb0cc15d3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:24.318645 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8f670444-8873-4103-a9bd-7aceb0cc15d3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:24.319081 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-8f670444-8873-4103-a9bd-7aceb0cc15d3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:24.450047 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-8f670444-8873-4103-a9bd-7aceb0cc15d3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:24.457658 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-8f670444-8873-4103-a9bd-7aceb0cc15d3 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.151909 Jul 15 16:10:24.458254 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 643/1289] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:24 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:25.473920 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-93159025-81b5-44d4-aeb0-20d8362342c5 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:25.476117 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-93159025-81b5-44d4-aeb0-20d8362342c5 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:25.483728 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-93159025-81b5-44d4-aeb0-20d8362342c5 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:25.484424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-93159025-81b5-44d4-aeb0-20d8362342c5 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:25.485537 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-93159025-81b5-44d4-aeb0-20d8362342c5 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:25.486184 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-93159025-81b5-44d4-aeb0-20d8362342c5 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:25.631666 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-93159025-81b5-44d4-aeb0-20d8362342c5 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:25.639249 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-93159025-81b5-44d4-aeb0-20d8362342c5 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.169268 Jul 15 16:10:25.639845 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 647/1290] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:25 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:26.655989 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-9e90c785-6621-436d-a91a-299a0901f663 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:26.656606 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-9e90c785-6621-436d-a91a-299a0901f663 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:26.663671 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e90c785-6621-436d-a91a-299a0901f663 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:26.664124 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e90c785-6621-436d-a91a-299a0901f663 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:26.664891 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e90c785-6621-436d-a91a-299a0901f663 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:26.665330 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-9e90c785-6621-436d-a91a-299a0901f663 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:26.800318 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-9e90c785-6621-436d-a91a-299a0901f663 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:26.808287 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-9e90c785-6621-436d-a91a-299a0901f663 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.156210 Jul 15 16:10:26.808849 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 644/1291] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:26 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:27.825424 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-9c9c6904-0233-42ce-94e3-f0840c009969 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:27.826054 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-9c9c6904-0233-42ce-94e3-f0840c009969 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:27.832104 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9c9c6904-0233-42ce-94e3-f0840c009969 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:27.832548 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9c9c6904-0233-42ce-94e3-f0840c009969 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:27.833303 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9c9c6904-0233-42ce-94e3-f0840c009969 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:27.833736 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-9c9c6904-0233-42ce-94e3-f0840c009969 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:27.972977 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-9c9c6904-0233-42ce-94e3-f0840c009969 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:27.980360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-9c9c6904-0233-42ce-94e3-f0840c009969 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.159010 Jul 15 16:10:27.981002 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 648/1292] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:27 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:28.520903 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-579ad591-3aa1-4aea-9b08-c5568daae4b1 req-3685feda-d861-4259-accb-3d2d9edd9f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295f8b34-f641-4a04-91cb-c76c493e9cb4", "name": "network-vif-plugged", "status": "completed", "tag": "b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:10:28.529586 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-579ad591-3aa1-4aea-9b08-c5568daae4b1 req-3685feda-d861-4259-accb-3d2d9edd9f0f service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:28.530033 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-579ad591-3aa1-4aea-9b08-c5568daae4b1 req-3685feda-d861-4259-accb-3d2d9edd9f0f service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:28.541387 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-579ad591-3aa1-4aea-9b08-c5568daae4b1 req-3685feda-d861-4259-accb-3d2d9edd9f0f service nova] Creating event network-vif-plugged:b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1 for instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 on hv-cinder-83587 Jul 15 16:10:28.546534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-579ad591-3aa1-4aea-9b08-c5568daae4b1 req-3685feda-d861-4259-accb-3d2d9edd9f0f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029757 Jul 15 16:10:28.547112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 645/1293] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:10:28.997533 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-80c1a662-406e-492f-8512-6ebbcafc10ed tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:28.998154 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-80c1a662-406e-492f-8512-6ebbcafc10ed tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:29.005068 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-80c1a662-406e-492f-8512-6ebbcafc10ed tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:29.005519 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-80c1a662-406e-492f-8512-6ebbcafc10ed tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:29.006281 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-80c1a662-406e-492f-8512-6ebbcafc10ed tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:29.006717 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-80c1a662-406e-492f-8512-6ebbcafc10ed tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:29.132567 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-80c1a662-406e-492f-8512-6ebbcafc10ed tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:29.140157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-80c1a662-406e-492f-8512-6ebbcafc10ed tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.146512 Jul 15 16:10:29.140713 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 649/1294] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:28 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:30.158616 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-fb55e69c-93e5-4431-a4fb-c74ea4296f3a tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:30.159369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-fb55e69c-93e5-4431-a4fb-c74ea4296f3a tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:30.165556 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fb55e69c-93e5-4431-a4fb-c74ea4296f3a tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:30.166006 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fb55e69c-93e5-4431-a4fb-c74ea4296f3a tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:30.166771 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fb55e69c-93e5-4431-a4fb-c74ea4296f3a tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:30.167204 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-fb55e69c-93e5-4431-a4fb-c74ea4296f3a tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:30.301156 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-fb55e69c-93e5-4431-a4fb-c74ea4296f3a tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:30.309033 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-fb55e69c-93e5-4431-a4fb-c74ea4296f3a tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1574 microversion: 2.1 time: 0.155192 Jul 15 16:10:30.310726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 646/1295] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:30 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:10:31.326060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-345284e8-ea05-463d-b9ba-e8d030787b3f tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:10:31.326659 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-345284e8-ea05-463d-b9ba-e8d030787b3f tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:10:31.333355 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-345284e8-ea05-463d-b9ba-e8d030787b3f tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:31.333808 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-345284e8-ea05-463d-b9ba-e8d030787b3f tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:31.334582 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-345284e8-ea05-463d-b9ba-e8d030787b3f tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:10:31.335060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-345284e8-ea05-463d-b9ba-e8d030787b3f tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:10:31.469090 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-345284e8-ea05-463d-b9ba-e8d030787b3f tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:10:31.477498 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-345284e8-ea05-463d-b9ba-e8d030787b3f tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1561 microversion: 2.1 time: 0.155344 Jul 15 16:10:31.478063 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 650/1296] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:10:31 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:11:50.692618 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:11:50.693312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 16:11:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:11:51.133769 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:11:51.134365 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:11:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:12:01.379858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=13 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:01.379858 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=66 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:01.383605 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-2033a989-a442-46a3-ab3c-36952688350b req-bee9ccce-809e-478f-aab8-e7c72c5c2c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295f8b34-f641-4a04-91cb-c76c493e9cb4", "tag": "b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:12:01.384627 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-013a9dfa-fbe4-49be-808b-c9d55d214dd4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:01.385534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-013a9dfa-fbe4-49be-808b-c9d55d214dd4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:01.388602 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e62363e0-531a-45ae-b537-7e9627418e65] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 15 16:12:01.389449 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=13 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:01.390332 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:01.392327 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-013a9dfa-fbe4-49be-808b-c9d55d214dd4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:01.392779 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-013a9dfa-fbe4-49be-808b-c9d55d214dd4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:01.393769 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-013a9dfa-fbe4-49be-808b-c9d55d214dd4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:01.394217 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-013a9dfa-fbe4-49be-808b-c9d55d214dd4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:01.396180 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-2033a989-a442-46a3-ab3c-36952688350b req-bee9ccce-809e-478f-aab8-e7c72c5c2c72 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:01.396633 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-2033a989-a442-46a3-ab3c-36952688350b req-bee9ccce-809e-478f-aab8-e7c72c5c2c72 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:01.409335 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-2033a989-a442-46a3-ab3c-36952688350b req-bee9ccce-809e-478f-aab8-e7c72c5c2c72 service nova] Creating event network-changed:b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1 for instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 on hv-cinder-83587 Jul 15 16:12:01.415413 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-2033a989-a442-46a3-ab3c-36952688350b req-bee9ccce-809e-478f-aab8-e7c72c5c2c72 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037806 Jul 15 16:12:01.416233 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 651/1297] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:12:01.430371 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-013a9dfa-fbe4-49be-808b-c9d55d214dd4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:12:01.791948 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-013a9dfa-fbe4-49be-808b-c9d55d214dd4 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "DELETE /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 204 len: 0 microversion: 2.1 time: 0.415967 Jul 15 16:12:01.795459 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 647/1298] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:12:01 2022] DELETE /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:12:01.801801 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-ee115b94-4d3a-4e2a-a2c0-c7e2ef170326 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:01.811481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-ee115b94-4d3a-4e2a-a2c0-c7e2ef170326 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:01.811481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ee115b94-4d3a-4e2a-a2c0-c7e2ef170326 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:01.811481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ee115b94-4d3a-4e2a-a2c0-c7e2ef170326 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:01.811481 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ee115b94-4d3a-4e2a-a2c0-c7e2ef170326 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:01.812118 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-ee115b94-4d3a-4e2a-a2c0-c7e2ef170326 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:01.961322 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-ee115b94-4d3a-4e2a-a2c0-c7e2ef170326 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:01.969502 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-ee115b94-4d3a-4e2a-a2c0-c7e2ef170326 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.171907 Jul 15 16:12:01.970071 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 652/1299] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:01 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:02.988179 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-c1b4b85a-09b2-4fe4-9877-c0867ac9351c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:02.993726 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-c1b4b85a-09b2-4fe4-9877-c0867ac9351c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:02.997777 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c1b4b85a-09b2-4fe4-9877-c0867ac9351c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:02.998238 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c1b4b85a-09b2-4fe4-9877-c0867ac9351c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:02.999003 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c1b4b85a-09b2-4fe4-9877-c0867ac9351c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:02.999518 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-c1b4b85a-09b2-4fe4-9877-c0867ac9351c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:03.135654 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-c1b4b85a-09b2-4fe4-9877-c0867ac9351c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:03.143246 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-c1b4b85a-09b2-4fe4-9877-c0867ac9351c tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1567 microversion: 2.1 time: 0.159333 Jul 15 16:12:03.143832 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 648/1300] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:02 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:04.090967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-90bc410c-3eff-4423-ab87-7f23ad7459c8 req-40876382-00cd-4905-a237-ab3cfd0c3a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295f8b34-f641-4a04-91cb-c76c493e9cb4", "name": "network-vif-deleted", "tag": "b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:12:04.103514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] [e62363e0-531a-45ae-b537-7e9627418e65] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 37572. Jul 15 16:12:04.108635 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-90bc410c-3eff-4423-ab87-7f23ad7459c8 req-40876382-00cd-4905-a237-ab3cfd0c3a2d service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:04.109077 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-90bc410c-3eff-4423-ab87-7f23ad7459c8 req-40876382-00cd-4905-a237-ab3cfd0c3a2d service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:04.120591 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-90bc410c-3eff-4423-ab87-7f23ad7459c8 req-40876382-00cd-4905-a237-ab3cfd0c3a2d service nova] Creating event network-vif-deleted:b3950f6b-47cf-4ef3-bbd2-ebb5f5077fd1 for instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 on hv-cinder-83587 Jul 15 16:12:04.125561 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-90bc410c-3eff-4423-ab87-7f23ad7459c8 req-40876382-00cd-4905-a237-ab3cfd0c3a2d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038524 Jul 15 16:12:04.126146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 653/1301] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:12:04.160478 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-620f20e5-c005-4cd8-afac-96a35a0005db tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:04.161289 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-620f20e5-c005-4cd8-afac-96a35a0005db tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:04.168046 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-620f20e5-c005-4cd8-afac-96a35a0005db tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:04.168501 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-620f20e5-c005-4cd8-afac-96a35a0005db tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:04.169279 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-620f20e5-c005-4cd8-afac-96a35a0005db tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:04.169757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-620f20e5-c005-4cd8-afac-96a35a0005db tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:04.231944 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-620f20e5-c005-4cd8-afac-96a35a0005db tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:04.239449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-620f20e5-c005-4cd8-afac-96a35a0005db tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1382 microversion: 2.1 time: 0.082949 Jul 15 16:12:04.240020 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 649/1302] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:04 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 16:12:05.257942 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:05.258632 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:05.265953 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:05.266399 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:05.267168 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:05.267639 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:05.299855 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:05.300340 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:05.300793 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lazy-loading 'fault' on Instance uuid 295f8b34-f641-4a04-91cb-c76c493e9cb4 {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:12:05.344368 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4578eaca578d4064977c32a2e8eb3267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5530af77f8d4d319251e5aa27d8a536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:05.352955 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-0258f141-f876-4793-9b41-a24fd7fb78ef tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 200 len: 1225 microversion: 2.1 time: 0.100011 Jul 15 16:12:05.353560 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 654/1303] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:05 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:06.373203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:06.373873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] [instance: 295f8b34-f641-4a04-91cb-c76c493e9cb4] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:06.385333 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:06.386138 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:06.387562 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:06.388361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:06.408551 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] HTTP exception thrown: Instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 could not be found. Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Request method failure captured: Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 HTTP/1.1 Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0ZCRNaJNMw-JvPxxQpQQVXTVQO0NVZskkI2Iz1uJppeftkY-NjXC9D3AUsgAK_3L5hEHtwasb87yRWGqG7mvSIZ1DEdivhiOWyU5L5xWh5fr_9kZIq5oR081aeoFGT1Ep8FAkQnzTqxdZmtb6WiS8i0BNUjt1nRFisLGHCQZY4jwevk Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: b5530af77f8d4d319251e5aa27d8a536 Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-TestShelveInstance-1956206669 Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:12:06.410192 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b5530af77f8d4d319251e5aa27d8a536"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b5530af77f8d4d319251e5aa27d8a536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b5530af77f8d4d319251e5aa27d8a536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b5530af77f8d4d319251e5aa27d8a536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-TestShelveInstance-1956206669 Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: b5530af77f8d4d319251e5aa27d8a536 Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-TestShelveInstance-1956206669 Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-TestShelveInstance-1956206669-project Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 4578eaca578d4064977c32a2e8eb3267 Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-TestShelveInstance-1956206669-project Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 could not be found. Jul 15 16:12:06.412082 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '295f8b34-f641-4a04-91cb-c76c493e9cb4'} Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 could not be found. Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:12:06.413314 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 could not be found. Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 could not be found. Jul 15 16:12:06.416276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:12:06.417836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Returning 404 to user: Instance 295f8b34-f641-4a04-91cb-c76c493e9cb4 could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:12:06.417836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-652b52f0-8d52-4309-81f8-0302f8fbe4c1 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4" status: 404 len: 111 microversion: 2.1 time: 0.042352 Jul 15 16:12:06.417836 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 650/1304] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:06 2022] GET /compute/v2.1/servers/295f8b34-f641-4a04-91cb-c76c493e9cb4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:12:06.698613 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-61ee5bb7-01ea-4d76-848c-c38d73f61b17 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] Calling method '.version_select at 0x7f510ab6cca0>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:06.797501 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-61ee5bb7-01ea-4d76-848c-c38d73f61b17 tempest-TestShelveInstance-1956206669 tempest-TestShelveInstance-1956206669-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1217782638" status: 202 len: 0 microversion: 2.1 time: 0.103149 Jul 15 16:12:06.798092 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 655/1305] 10.222.0.98 () {58 vars in 1253 bytes} [Fri Jul 15 16:12:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1217782638 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 16:12:21.636220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-865548863", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1496139757", "security_groups": [{"name": "tempest-secgroup-smoke-217764526"}], "block_device_mapping_v2": [{"uuid": "f296aaa5-2d1b-412b-b03b-6dcfa8e78da6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9dd76655-49f1-4b8f-9861-8e5cd93edef6"}]}} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:12:21.644604 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:21.645261 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:21.751583 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.network.neutron [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] validate_networks() for [('9dd76655-49f1-4b8f-9861-8e5cd93edef6', None, None, None, None, None)] {{(pid=130090) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 16:12:22.218853 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Flavor limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 16:12:22.219276 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Image limits 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 16:12:22.219775 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Flavor pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 16:12:22.220182 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Image pref 0:0:0 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 16:12:22.220589 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.virt.hardware [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 16:12:22.229369 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:22.229815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:22.234344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:22.234344 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:22.248161 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Getting quotas for project 801e210cf8c64e7184b178fbde47860c. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 16:12:22.252027 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.quota [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Getting quotas for user 14fecc08cd364a48a8640d522577aa39 and project 801e210cf8c64e7184b178fbde47860c. Resources: {'ram', 'cores', 'instances'} {{(pid=130090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 16:12:22.308721 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Going to run 1 instances... {{(pid=130090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 16:12:22.310811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f296aaa5-2d1b-412b-b03b-6dcfa8e78da6',volume_size=None,volume_type=None)] {{(pid=130090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 16:12:22.713509 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4b050165-6dcf-4727-8c10-8a304d799a4e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.081219 Jul 15 16:12:22.714477 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 651/1306] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Jul 15 16:12:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 16:12:22.724250 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-502ec636-2099-4e8c-95c8-40e6a1dd2ed4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:22.724866 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-502ec636-2099-4e8c-95c8-40e6a1dd2ed4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:22.728297 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=18 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:22.729060 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:22.788360 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-502ec636-2099-4e8c-95c8-40e6a1dd2ed4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:22.795812 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-502ec636-2099-4e8c-95c8-40e6a1dd2ed4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1094 microversion: 2.1 time: 0.075391 Jul 15 16:12:22.796385 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 656/1307] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:22 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:23.812762 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-3d88e39d-22d5-44fc-8dea-3076af6c3ed1 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:23.813372 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-3d88e39d-22d5-44fc-8dea-3076af6c3ed1 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:23.820741 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d88e39d-22d5-44fc-8dea-3076af6c3ed1 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:23.821925 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d88e39d-22d5-44fc-8dea-3076af6c3ed1 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:23.822695 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d88e39d-22d5-44fc-8dea-3076af6c3ed1 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:23.823129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-3d88e39d-22d5-44fc-8dea-3076af6c3ed1 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:23.885090 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-3d88e39d-22d5-44fc-8dea-3076af6c3ed1 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:23.892786 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-3d88e39d-22d5-44fc-8dea-3076af6c3ed1 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1144 microversion: 2.1 time: 0.083912 Jul 15 16:12:23.893375 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 652/1308] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:23 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:24.909758 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-92857447-bbf5-40b6-8757-d9d7bd218f3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:24.910326 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-92857447-bbf5-40b6-8757-d9d7bd218f3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:24.917480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92857447-bbf5-40b6-8757-d9d7bd218f3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:24.917930 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92857447-bbf5-40b6-8757-d9d7bd218f3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:24.918708 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92857447-bbf5-40b6-8757-d9d7bd218f3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:24.919152 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-92857447-bbf5-40b6-8757-d9d7bd218f3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:24.982997 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-92857447-bbf5-40b6-8757-d9d7bd218f3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:24.990523 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-92857447-bbf5-40b6-8757-d9d7bd218f3a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1192 microversion: 2.1 time: 0.084543 Jul 15 16:12:24.991099 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 657/1309] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:24 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:26.007940 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-2973af16-d369-4ec8-9d4f-5677fd61fddc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:26.008571 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-2973af16-d369-4ec8-9d4f-5677fd61fddc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:26.015661 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2973af16-d369-4ec8-9d4f-5677fd61fddc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:26.016052 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2973af16-d369-4ec8-9d4f-5677fd61fddc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:26.016816 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2973af16-d369-4ec8-9d4f-5677fd61fddc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:26.017253 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-2973af16-d369-4ec8-9d4f-5677fd61fddc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:26.186925 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-2973af16-d369-4ec8-9d4f-5677fd61fddc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:26.194354 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-2973af16-d369-4ec8-9d4f-5677fd61fddc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1277 microversion: 2.1 time: 0.190434 Jul 15 16:12:26.194917 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 653/1310] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:26 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:27.214044 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-061b427b-d2c3-47be-9166-1d7f7deabfe3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:27.218681 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-061b427b-d2c3-47be-9166-1d7f7deabfe3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:27.221150 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-061b427b-d2c3-47be-9166-1d7f7deabfe3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:27.221598 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-061b427b-d2c3-47be-9166-1d7f7deabfe3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:27.222363 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-061b427b-d2c3-47be-9166-1d7f7deabfe3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:27.222797 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-061b427b-d2c3-47be-9166-1d7f7deabfe3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:27.287229 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-a03199cd-b7ba-4f6d-9383-cd0775152cf1 req-ab4f56ca-4891-4293-a704-762066d3f565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8ce672-0a32-4ad6-9b59-fc588d2dae82", "tag": "b195aae8-508b-445f-acaa-f8c1e5ffa9fd"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:12:27.295492 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a03199cd-b7ba-4f6d-9383-cd0775152cf1 req-ab4f56ca-4891-4293-a704-762066d3f565 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:27.296187 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-a03199cd-b7ba-4f6d-9383-cd0775152cf1 req-ab4f56ca-4891-4293-a704-762066d3f565 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:27.308757 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-a03199cd-b7ba-4f6d-9383-cd0775152cf1 req-ab4f56ca-4891-4293-a704-762066d3f565 service nova] Creating event network-changed:b195aae8-508b-445f-acaa-f8c1e5ffa9fd for instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 on hv-cinder-83587 Jul 15 16:12:27.317133 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-a03199cd-b7ba-4f6d-9383-cd0775152cf1 req-ab4f56ca-4891-4293-a704-762066d3f565 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033289 Jul 15 16:12:27.319455 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 654/1311] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:12:27.388750 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-061b427b-d2c3-47be-9166-1d7f7deabfe3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:27.397200 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-061b427b-d2c3-47be-9166-1d7f7deabfe3 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.187576 Jul 15 16:12:27.397879 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 658/1312] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:27 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:28.415688 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-25b0a440-19c4-4ebd-a813-3afebf1f5b67 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:28.416394 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-25b0a440-19c4-4ebd-a813-3afebf1f5b67 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:28.422643 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-25b0a440-19c4-4ebd-a813-3afebf1f5b67 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:28.423095 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-25b0a440-19c4-4ebd-a813-3afebf1f5b67 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:28.423884 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-25b0a440-19c4-4ebd-a813-3afebf1f5b67 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:28.424323 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-25b0a440-19c4-4ebd-a813-3afebf1f5b67 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:28.555063 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-25b0a440-19c4-4ebd-a813-3afebf1f5b67 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:28.562601 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-25b0a440-19c4-4ebd-a813-3afebf1f5b67 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.152339 Jul 15 16:12:28.563169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 655/1313] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:28 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:29.580242 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-507ba53d-509b-454a-b7a0-28b471452b7c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:29.580863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-507ba53d-509b-454a-b7a0-28b471452b7c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:29.587615 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-507ba53d-509b-454a-b7a0-28b471452b7c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:29.588088 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-507ba53d-509b-454a-b7a0-28b471452b7c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:29.588867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-507ba53d-509b-454a-b7a0-28b471452b7c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:29.589312 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-507ba53d-509b-454a-b7a0-28b471452b7c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:29.717146 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-507ba53d-509b-454a-b7a0-28b471452b7c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:29.724701 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-507ba53d-509b-454a-b7a0-28b471452b7c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.148549 Jul 15 16:12:29.725265 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 659/1314] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:29 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:30.741540 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-623ec05a-cc30-4de1-8852-bdfa234c371a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:30.742160 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-623ec05a-cc30-4de1-8852-bdfa234c371a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:30.749353 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-623ec05a-cc30-4de1-8852-bdfa234c371a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:30.749806 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-623ec05a-cc30-4de1-8852-bdfa234c371a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:30.756641 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-623ec05a-cc30-4de1-8852-bdfa234c371a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:30.756641 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-623ec05a-cc30-4de1-8852-bdfa234c371a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:30.883694 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-623ec05a-cc30-4de1-8852-bdfa234c371a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:30.891682 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-623ec05a-cc30-4de1-8852-bdfa234c371a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.153983 Jul 15 16:12:30.892248 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 656/1315] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:30 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:31.909026 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-6f8ad4e5-6751-4fb7-9ba2-ac39b9c8ea7a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:31.909573 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-6f8ad4e5-6751-4fb7-9ba2-ac39b9c8ea7a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:31.916069 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f8ad4e5-6751-4fb7-9ba2-ac39b9c8ea7a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:31.916518 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f8ad4e5-6751-4fb7-9ba2-ac39b9c8ea7a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:31.917334 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f8ad4e5-6751-4fb7-9ba2-ac39b9c8ea7a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:31.917765 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-6f8ad4e5-6751-4fb7-9ba2-ac39b9c8ea7a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:32.049837 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-6f8ad4e5-6751-4fb7-9ba2-ac39b9c8ea7a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:32.058222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-6f8ad4e5-6751-4fb7-9ba2-ac39b9c8ea7a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.153129 Jul 15 16:12:32.058791 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 660/1316] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:31 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:33.073922 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-5b679dff-ee14-4702-92d0-33cd49b9cc5b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:33.074635 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-5b679dff-ee14-4702-92d0-33cd49b9cc5b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:33.077132 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=2 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:33.077743 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell0:SELECT=6 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:33.082565 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b679dff-ee14-4702-92d0-33cd49b9cc5b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:33.083021 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b679dff-ee14-4702-92d0-33cd49b9cc5b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:33.083844 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b679dff-ee14-4702-92d0-33cd49b9cc5b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:33.084281 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-5b679dff-ee14-4702-92d0-33cd49b9cc5b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:33.216472 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-5b679dff-ee14-4702-92d0-33cd49b9cc5b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:33.223984 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-5b679dff-ee14-4702-92d0-33cd49b9cc5b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.153906 Jul 15 16:12:33.224561 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 657/1317] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:33 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:34.241440 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c986e1f3-b3ec-448b-ab6c-9e372ffea24a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:34.242087 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c986e1f3-b3ec-448b-ab6c-9e372ffea24a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:34.244658 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell0:SELECT=2 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:12:34.249480 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c986e1f3-b3ec-448b-ab6c-9e372ffea24a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:34.249935 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c986e1f3-b3ec-448b-ab6c-9e372ffea24a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:34.250704 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c986e1f3-b3ec-448b-ab6c-9e372ffea24a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:34.251140 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c986e1f3-b3ec-448b-ab6c-9e372ffea24a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:34.383401 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c986e1f3-b3ec-448b-ab6c-9e372ffea24a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:34.391491 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c986e1f3-b3ec-448b-ab6c-9e372ffea24a tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.153873 Jul 15 16:12:34.392051 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 661/1318] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:34 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:35.408220 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-01f375ff-26ff-4678-b105-2daf1cb5a9ba tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:35.409207 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-01f375ff-26ff-4678-b105-2daf1cb5a9ba tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:35.415271 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-01f375ff-26ff-4678-b105-2daf1cb5a9ba tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:35.415756 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-01f375ff-26ff-4678-b105-2daf1cb5a9ba tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:35.416520 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-01f375ff-26ff-4678-b105-2daf1cb5a9ba tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:35.416954 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-01f375ff-26ff-4678-b105-2daf1cb5a9ba tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:35.554496 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-01f375ff-26ff-4678-b105-2daf1cb5a9ba tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:35.562449 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-01f375ff-26ff-4678-b105-2daf1cb5a9ba tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.158173 Jul 15 16:12:35.563012 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 658/1319] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:35 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:36.579223 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-beff5949-e163-40fc-a533-b2f12bac0e80 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:36.579923 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-beff5949-e163-40fc-a533-b2f12bac0e80 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:36.586777 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-beff5949-e163-40fc-a533-b2f12bac0e80 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:36.587229 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-beff5949-e163-40fc-a533-b2f12bac0e80 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:36.588513 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-beff5949-e163-40fc-a533-b2f12bac0e80 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:36.588964 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-beff5949-e163-40fc-a533-b2f12bac0e80 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:36.718895 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-beff5949-e163-40fc-a533-b2f12bac0e80 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:36.726330 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-beff5949-e163-40fc-a533-b2f12bac0e80 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.150991 Jul 15 16:12:36.726895 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 662/1320] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:36 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:37.748222 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4560762b-d614-413c-b04a-950a617f6363 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:37.748842 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4560762b-d614-413c-b04a-950a617f6363 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:37.755676 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4560762b-d614-413c-b04a-950a617f6363 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:37.756129 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4560762b-d614-413c-b04a-950a617f6363 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:37.756904 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4560762b-d614-413c-b04a-950a617f6363 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:37.757341 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4560762b-d614-413c-b04a-950a617f6363 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:37.888492 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-4560762b-d614-413c-b04a-950a617f6363 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:37.896111 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4560762b-d614-413c-b04a-950a617f6363 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.152395 Jul 15 16:12:37.896692 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 659/1321] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:37 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:38.913191 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-2e633fdf-f52f-4924-8a1e-52170af4cd59 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:38.913810 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-2e633fdf-f52f-4924-8a1e-52170af4cd59 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:38.920464 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2e633fdf-f52f-4924-8a1e-52170af4cd59 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:38.920919 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2e633fdf-f52f-4924-8a1e-52170af4cd59 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:38.921696 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2e633fdf-f52f-4924-8a1e-52170af4cd59 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:38.922138 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-2e633fdf-f52f-4924-8a1e-52170af4cd59 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:39.055643 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-e0b3b04d-b566-469e-b9e3-6f3305e7125d req-28509f50-6248-4120-9df9-9994fdc15270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8ce672-0a32-4ad6-9b59-fc588d2dae82", "name": "network-vif-plugged", "status": "completed", "tag": "b195aae8-508b-445f-acaa-f8c1e5ffa9fd"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:12:39.060738 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-2e633fdf-f52f-4924-8a1e-52170af4cd59 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:39.065164 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-e0b3b04d-b566-469e-b9e3-6f3305e7125d req-28509f50-6248-4120-9df9-9994fdc15270 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:39.065684 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-e0b3b04d-b566-469e-b9e3-6f3305e7125d req-28509f50-6248-4120-9df9-9994fdc15270 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:39.068568 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-2e633fdf-f52f-4924-8a1e-52170af4cd59 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.159226 Jul 15 16:12:39.069123 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 663/1322] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:38 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:39.077600 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-e0b3b04d-b566-469e-b9e3-6f3305e7125d req-28509f50-6248-4120-9df9-9994fdc15270 service nova] Creating event network-vif-plugged:b195aae8-508b-445f-acaa-f8c1e5ffa9fd for instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 on hv-cinder-83587 Jul 15 16:12:39.082645 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-e0b3b04d-b566-469e-b9e3-6f3305e7125d req-28509f50-6248-4120-9df9-9994fdc15270 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030797 Jul 15 16:12:39.083232 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 660/1323] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:12:40.086282 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-1972d4e1-5a19-482e-a164-8461bb1a1c7b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:40.086914 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-1972d4e1-5a19-482e-a164-8461bb1a1c7b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:40.094202 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1972d4e1-5a19-482e-a164-8461bb1a1c7b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:40.094645 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1972d4e1-5a19-482e-a164-8461bb1a1c7b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:40.095427 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1972d4e1-5a19-482e-a164-8461bb1a1c7b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:40.095862 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-1972d4e1-5a19-482e-a164-8461bb1a1c7b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:40.223623 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-1972d4e1-5a19-482e-a164-8461bb1a1c7b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:40.231103 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-1972d4e1-5a19-482e-a164-8461bb1a1c7b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1265 microversion: 2.1 time: 0.148815 Jul 15 16:12:40.231967 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 664/1324] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:40 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:41.248959 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-938f7eb4-56db-468c-b78f-e10f8fee84ea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:41.249669 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-938f7eb4-56db-468c-b78f-e10f8fee84ea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:41.255913 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-938f7eb4-56db-468c-b78f-e10f8fee84ea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:41.261865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-938f7eb4-56db-468c-b78f-e10f8fee84ea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:41.261865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-938f7eb4-56db-468c-b78f-e10f8fee84ea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:41.261865 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-938f7eb4-56db-468c-b78f-e10f8fee84ea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:41.458856 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-938f7eb4-56db-468c-b78f-e10f8fee84ea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:41.466842 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-938f7eb4-56db-468c-b78f-e10f8fee84ea tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1453 microversion: 2.1 time: 0.222564 Jul 15 16:12:41.467450 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 661/1325] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:41 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:41.483700 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5cc17f86-1aab-4524-b4f8-9ba8e4a1e13c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:12:41.484315 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5cc17f86-1aab-4524-b4f8-9ba8e4a1e13c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:12:41.490545 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5cc17f86-1aab-4524-b4f8-9ba8e4a1e13c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:41.491003 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5cc17f86-1aab-4524-b4f8-9ba8e4a1e13c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:41.491815 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5cc17f86-1aab-4524-b4f8-9ba8e4a1e13c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:41.492256 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5cc17f86-1aab-4524-b4f8-9ba8e4a1e13c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:41.625133 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5cc17f86-1aab-4524-b4f8-9ba8e4a1e13c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:12:41.631444 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5cc17f86-1aab-4524-b4f8-9ba8e4a1e13c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1453 microversion: 2.1 time: 0.152657 Jul 15 16:12:41.632043 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 665/1326] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:12:41 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:12:43.784096 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-7a9e47cc-fae3-46f4-8cc8-4391903ad7fd req-8bd06b0d-221e-4989-b1ba-046d451098b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8ce672-0a32-4ad6-9b59-fc588d2dae82", "tag": "b195aae8-508b-445f-acaa-f8c1e5ffa9fd"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:12:43.793216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-7a9e47cc-fae3-46f4-8cc8-4391903ad7fd req-8bd06b0d-221e-4989-b1ba-046d451098b9 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:12:43.793655 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-7a9e47cc-fae3-46f4-8cc8-4391903ad7fd req-8bd06b0d-221e-4989-b1ba-046d451098b9 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:12:43.804644 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-7a9e47cc-fae3-46f4-8cc8-4391903ad7fd req-8bd06b0d-221e-4989-b1ba-046d451098b9 service nova] Creating event network-changed:b195aae8-508b-445f-acaa-f8c1e5ffa9fd for instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 on hv-cinder-83587 Jul 15 16:12:43.810169 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-7a9e47cc-fae3-46f4-8cc8-4391903ad7fd req-8bd06b0d-221e-4989-b1ba-046d451098b9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177735 Jul 15 16:12:43.810873 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 662/1327] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:13:30.436890 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:13:30.437446 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 16:13:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:14:09.355751 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:14:09.356468 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 16:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:14:35.071908 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_api:SELECT=22 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:14:35.073108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG dbcounter [-] [130091] Writing DB stats nova_cell1:SELECT=54 {{(pid=130091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:14:35.075275 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76a18289-1e08-4ac1-a9d4-e35f88ac1b76] AMQP server on 10.222.0.98:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 15 16:14:35.075902 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:14:35.077203 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG dbcounter [-] [130090] Writing DB stats nova_cell1:SELECT=56 {{(pid=130090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:14:35.077798 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-dd18a23f-e4e0-4691-8d5f-992cab15dc9d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:35.078422 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dd18a23f-e4e0-4691-8d5f-992cab15dc9d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:35.082176 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [req-71cdb708-6170-41f9-a509-a6a91df79044 req-bac1aaa1-44c6-4797-8d70-ca965a25a980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8ce672-0a32-4ad6-9b59-fc588d2dae82", "tag": "b195aae8-508b-445f-acaa-f8c1e5ffa9fd"}]} {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:14:35.086270 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd18a23f-e4e0-4691-8d5f-992cab15dc9d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:35.086433 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd18a23f-e4e0-4691-8d5f-992cab15dc9d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:35.087157 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd18a23f-e4e0-4691-8d5f-992cab15dc9d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:35.087626 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-dd18a23f-e4e0-4691-8d5f-992cab15dc9d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:35.090811 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-71cdb708-6170-41f9-a509-a6a91df79044 req-bac1aaa1-44c6-4797-8d70-ca965a25a980 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:35.091270 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [req-71cdb708-6170-41f9-a509-a6a91df79044 req-bac1aaa1-44c6-4797-8d70-ca965a25a980 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:35.103038 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.compute.server_external_events [req-71cdb708-6170-41f9-a509-a6a91df79044 req-bac1aaa1-44c6-4797-8d70-ca965a25a980 service nova] Creating event network-changed:b195aae8-508b-445f-acaa-f8c1e5ffa9fd for instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 on hv-cinder-83587 Jul 15 16:14:35.109216 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [req-71cdb708-6170-41f9-a509-a6a91df79044 req-bac1aaa1-44c6-4797-8d70-ca965a25a980 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036656 Jul 15 16:14:35.113840 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 663/1328] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:14:35.116040 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-dd18a23f-e4e0-4691-8d5f-992cab15dc9d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Going to try to terminate instance {{(pid=130091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:14:35.418442 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-dd18a23f-e4e0-4691-8d5f-992cab15dc9d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 204 len: 0 microversion: 2.1 time: 0.348535 Jul 15 16:14:35.419116 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 666/1329] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:14:35 2022] DELETE /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:14:35.435064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-ead2574b-77c8-4bbe-aa67-3c4f1081e8f0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:35.435064 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-ead2574b-77c8-4bbe-aa67-3c4f1081e8f0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:35.436617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ead2574b-77c8-4bbe-aa67-3c4f1081e8f0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:35.437190 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ead2574b-77c8-4bbe-aa67-3c4f1081e8f0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:35.438029 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ead2574b-77c8-4bbe-aa67-3c4f1081e8f0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:35.438934 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-ead2574b-77c8-4bbe-aa67-3c4f1081e8f0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:35.589945 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-ead2574b-77c8-4bbe-aa67-3c4f1081e8f0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:14:35.598495 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-ead2574b-77c8-4bbe-aa67-3c4f1081e8f0 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1578 microversion: 2.1 time: 0.174028 Jul 15 16:14:35.599069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 664/1330] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:35 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:14:36.618396 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-c39baca3-fdbe-4a51-9c64-f0d0935f2984 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:36.619208 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-c39baca3-fdbe-4a51-9c64-f0d0935f2984 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:36.626221 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c39baca3-fdbe-4a51-9c64-f0d0935f2984 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:36.626677 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c39baca3-fdbe-4a51-9c64-f0d0935f2984 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:36.627487 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c39baca3-fdbe-4a51-9c64-f0d0935f2984 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:36.627933 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-c39baca3-fdbe-4a51-9c64-f0d0935f2984 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:36.762399 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-c39baca3-fdbe-4a51-9c64-f0d0935f2984 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:14:36.770870 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-c39baca3-fdbe-4a51-9c64-f0d0935f2984 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1578 microversion: 2.1 time: 0.157393 Jul 15 16:14:36.771471 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 667/1331] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:36 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:14:37.788024 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e51ded63-5433-4e9d-81a6-ca6daa56d76b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:37.788680 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e51ded63-5433-4e9d-81a6-ca6daa56d76b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:37.800206 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] [76a18289-1e08-4ac1-a9d4-e35f88ac1b76] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 37802. Jul 15 16:14:37.806680 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e51ded63-5433-4e9d-81a6-ca6daa56d76b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:37.807419 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e51ded63-5433-4e9d-81a6-ca6daa56d76b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:37.808162 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e51ded63-5433-4e9d-81a6-ca6daa56d76b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:37.808628 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e51ded63-5433-4e9d-81a6-ca6daa56d76b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:37.879765 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-a1c9c100-7dee-49e3-a6b6-d28326706247 req-2c6a9043-bdff-4595-aaf9-334e54bea083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8ce672-0a32-4ad6-9b59-fc588d2dae82", "name": "network-vif-deleted", "tag": "b195aae8-508b-445f-acaa-f8c1e5ffa9fd"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:14:37.889112 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-a1c9c100-7dee-49e3-a6b6-d28326706247 req-2c6a9043-bdff-4595-aaf9-334e54bea083 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:37.892729 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-a1c9c100-7dee-49e3-a6b6-d28326706247 req-2c6a9043-bdff-4595-aaf9-334e54bea083 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:37.893583 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e51ded63-5433-4e9d-81a6-ca6daa56d76b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:14:37.901980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-a1c9c100-7dee-49e3-a6b6-d28326706247 req-2c6a9043-bdff-4595-aaf9-334e54bea083 service nova] Creating event network-vif-deleted:b195aae8-508b-445f-acaa-f8c1e5ffa9fd for instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 on hv-cinder-83587 Jul 15 16:14:37.902395 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e51ded63-5433-4e9d-81a6-ca6daa56d76b tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1392 microversion: 2.1 time: 0.118507 Jul 15 16:14:37.902974 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 665/1332] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:37 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1392 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:14:37.907593 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-a1c9c100-7dee-49e3-a6b6-d28326706247 req-2c6a9043-bdff-4595-aaf9-334e54bea083 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032264 Jul 15 16:14:37.908331 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 668/1333] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 16:14:38.919421 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:38.920112 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:38.926393 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:38.926846 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:38.927652 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:38.928096 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:38.960514 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:38.960963 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:38.961418 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.objects.instance [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lazy-loading 'fault' on Instance uuid 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 {{(pid=130090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:14:39.003014 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:14:39.010475 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-d5c6ca54-179b-45b1-8fef-b9f837259e02 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 200 len: 1230 microversion: 2.1 time: 0.095043 Jul 15 16:14:39.011039 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 666/1334] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:38 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:14:40.029110 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:40.029815 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 3a8ce672-0a32-4ad6-9b59-fc588d2dae82] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:40.036728 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:40.037183 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:40.037970 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:40.038415 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:40.052320 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] HTTP exception thrown: Instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 could not be found. Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Request method failure captured: Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 HTTP/1.1 Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0ZB8ig3-cilnd9jQ8TSt849jlWhSvfUwvMUQotyF5hwBzuNu9hGIi-XItaqQSJamjrznFqzspqIuR0WpAxpLa0HQkZbGeZLc1_zt4I-YzMPHZu8bAngsGZ94x5CWfpp-aTKANUo3V5WaNQJZkUrmA0Os0-SaVVN13rqzQEgNIWJ3hds Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:14:40.054038 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_801e210cf8c64e7184b178fbde47860c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 14fecc08cd364a48a8640d522577aa39 Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 could not be found. Jul 15 16:14:40.055863 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '3a8ce672-0a32-4ad6-9b59-fc588d2dae82'} Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 could not be found. Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:14:40.056898 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 could not be found. Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 could not be found. Jul 15 16:14:40.058689 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:40.060559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Returning 404 to user: Instance 3a8ce672-0a32-4ad6-9b59-fc588d2dae82 could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:14:40.060559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-55077f1d-ab00-4b17-8396-875af74f1fac tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82" status: 404 len: 111 microversion: 2.1 time: 0.031183 Jul 15 16:14:40.060559 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 669/1335] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:40 2022] GET /compute/v2.1/servers/3a8ce672-0a32-4ad6-9b59-fc588d2dae82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:14:43.674534 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-4e61e547-f8d8-43bf-9f88-07e319b08ef4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:43.675094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4e61e547-f8d8-43bf-9f88-07e319b08ef4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:43.678154 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-0b7cf111-6628-43e9-8a05-f11136640faa req-23c19e3f-06af-4a48-b939-63514d03b321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a23251-1065-4120-9225-0355fffc3b7a", "tag": "6dd32f5a-add9-40f0-b846-e0e4e904c4a3"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:14:43.682587 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4e61e547-f8d8-43bf-9f88-07e319b08ef4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:43.683043 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4e61e547-f8d8-43bf-9f88-07e319b08ef4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:43.683892 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4e61e547-f8d8-43bf-9f88-07e319b08ef4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:43.684338 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-4e61e547-f8d8-43bf-9f88-07e319b08ef4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:43.687590 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-0b7cf111-6628-43e9-8a05-f11136640faa req-23c19e3f-06af-4a48-b939-63514d03b321 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:43.688250 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-0b7cf111-6628-43e9-8a05-f11136640faa req-23c19e3f-06af-4a48-b939-63514d03b321 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:43.699734 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-0b7cf111-6628-43e9-8a05-f11136640faa req-23c19e3f-06af-4a48-b939-63514d03b321 service nova] Creating event network-changed:6dd32f5a-add9-40f0-b846-e0e4e904c4a3 for instance 15a23251-1065-4120-9225-0355fffc3b7a on hv-cinder-83587 Jul 15 16:14:43.705182 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-0b7cf111-6628-43e9-8a05-f11136640faa req-23c19e3f-06af-4a48-b939-63514d03b321 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031841 Jul 15 16:14:43.705859 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 670/1336] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:14:43.712474 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-4e61e547-f8d8-43bf-9f88-07e319b08ef4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Going to try to terminate instance {{(pid=130090) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 16:14:44.016833 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-4e61e547-f8d8-43bf-9f88-07e319b08ef4 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "DELETE /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 204 len: 0 microversion: 2.1 time: 0.346001 Jul 15 16:14:44.017594 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 667/1337] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:14:43 2022] DELETE /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 16:14:44.027096 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-45ac3392-d878-4085-ab88-e3c2c8ee530c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:44.027827 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-45ac3392-d878-4085-ab88-e3c2c8ee530c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:44.034451 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-45ac3392-d878-4085-ab88-e3c2c8ee530c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:44.034908 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-45ac3392-d878-4085-ab88-e3c2c8ee530c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:44.035727 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-45ac3392-d878-4085-ab88-e3c2c8ee530c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:44.036747 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-45ac3392-d878-4085-ab88-e3c2c8ee530c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:44.185739 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-45ac3392-d878-4085-ab88-e3c2c8ee530c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:14:44.193744 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-45ac3392-d878-4085-ab88-e3c2c8ee530c tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1577 microversion: 2.1 time: 0.170925 Jul 15 16:14:44.194320 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 671/1338] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:44 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:14:45.211949 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-36302350-5f66-4043-835c-24488ab7ee7d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:45.212721 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-36302350-5f66-4043-835c-24488ab7ee7d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:45.219438 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-36302350-5f66-4043-835c-24488ab7ee7d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:45.219888 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-36302350-5f66-4043-835c-24488ab7ee7d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:45.220717 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-36302350-5f66-4043-835c-24488ab7ee7d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:45.221152 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-36302350-5f66-4043-835c-24488ab7ee7d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:45.361005 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-36302350-5f66-4043-835c-24488ab7ee7d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:14:45.369919 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-36302350-5f66-4043-835c-24488ab7ee7d tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1577 microversion: 2.1 time: 0.162280 Jul 15 16:14:45.370529 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 668/1339] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:45 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:14:46.254096 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [req-cb22d007-fd13-4e07-9b0e-2be3e1970072 req-6211813d-9ac7-453e-b4b0-a847f3ac5406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a23251-1065-4120-9225-0355fffc3b7a", "name": "network-vif-deleted", "tag": "6dd32f5a-add9-40f0-b846-e0e4e904c4a3"}]} {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 16:14:46.263762 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-cb22d007-fd13-4e07-9b0e-2be3e1970072 req-6211813d-9ac7-453e-b4b0-a847f3ac5406 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:46.264241 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [req-cb22d007-fd13-4e07-9b0e-2be3e1970072 req-6211813d-9ac7-453e-b4b0-a847f3ac5406 service nova] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:46.276226 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.compute.server_external_events [req-cb22d007-fd13-4e07-9b0e-2be3e1970072 req-6211813d-9ac7-453e-b4b0-a847f3ac5406 service nova] Creating event network-vif-deleted:6dd32f5a-add9-40f0-b846-e0e4e904c4a3 for instance 15a23251-1065-4120-9225-0355fffc3b7a on hv-cinder-83587 Jul 15 16:14:46.281104 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [req-cb22d007-fd13-4e07-9b0e-2be3e1970072 req-6211813d-9ac7-453e-b4b0-a847f3ac5406 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030645 Jul 15 16:14:46.281685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 672/1340] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Jul 15 16:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 16:14:46.386835 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e476c4f1-bc41-41ed-9382-c467591cb45e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:46.387617 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e476c4f1-bc41-41ed-9382-c467591cb45e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:46.394361 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e476c4f1-bc41-41ed-9382-c467591cb45e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:46.394912 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e476c4f1-bc41-41ed-9382-c467591cb45e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:46.396128 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e476c4f1-bc41-41ed-9382-c467591cb45e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:46.399069 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e476c4f1-bc41-41ed-9382-c467591cb45e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:46.463415 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.policy [None req-e476c4f1-bc41-41ed-9382-c467591cb45e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130090) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:14:46.472137 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e476c4f1-bc41-41ed-9382-c467591cb45e tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1226 microversion: 2.1 time: 0.089333 Jul 15 16:14:46.472709 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 669/1341] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:46 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:14:47.491366 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:47.491985 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:47.500107 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:47.507509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:47.507509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:47.507509 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:47.536215 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:47.536636 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:47.537108 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.objects.instance [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lazy-loading 'fault' on Instance uuid 15a23251-1065-4120-9225-0355fffc3b7a {{(pid=130091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 16:14:47.579048 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.policy [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fecc08cd364a48a8640d522577aa39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e210cf8c64e7184b178fbde47860c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130091) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 16:14:47.586514 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-5d14d4e3-2310-49d5-b3de-61d0b2dcd513 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 200 len: 1185 microversion: 2.1 time: 0.100214 Jul 15 16:14:47.587084 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 673/1342] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:47 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 1185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 16:14:48.604416 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:48.605035 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 15a23251-1065-4120-9225-0355fffc3b7a] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:48.611626 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:48.612083 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:48.613114 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:48.613554 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:48.626657 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] HTTP exception thrown: Instance 15a23251-1065-4120-9225-0355fffc3b7a could not be found. Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Request method failure captured: Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a HTTP/1.1 Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0ZB8ig3-cilnd9jQ8TSt849jlWhSvfUwvMUQotyF5hwBzuNu9hGIi-XItaqQSJamjrznFqzspqIuR0WpAxpLa0HQkZbGeZLc1_zt4I-YzMPHZu8bAngsGZ94x5CWfpp-aTKANUo3V5WaNQJZkUrmA0Os0-SaVVN13rqzQEgNIWJ3hds Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:14:48.628297 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_801e210cf8c64e7184b178fbde47860c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 14fecc08cd364a48a8640d522577aa39 Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 15a23251-1065-4120-9225-0355fffc3b7a could not be found. Jul 15 16:14:48.630131 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '15a23251-1065-4120-9225-0355fffc3b7a'} Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a23251-1065-4120-9225-0355fffc3b7a could not be found. Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:14:48.631584 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a23251-1065-4120-9225-0355fffc3b7a could not be found. Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a23251-1065-4120-9225-0355fffc3b7a could not be found. Jul 15 16:14:48.633381 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:48.635127 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Returning 404 to user: Instance 15a23251-1065-4120-9225-0355fffc3b7a could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:14:48.635127 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-e993a74d-f826-4343-8cd1-ef5e53df96cc tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a" status: 404 len: 111 microversion: 2.1 time: 0.029861 Jul 15 16:14:48.635127 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 670/1343] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:48 2022] GET /compute/v2.1/servers/15a23251-1065-4120-9225-0355fffc3b7a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:14:49.142050 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:49.142561 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.compute.api [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130091) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:49.149686 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:49.150741 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:49.150979 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:49.151465 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG oslo_concurrency.lockutils [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:49.164560 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.wsgi [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] HTTP exception thrown: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Request method failure captured: Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: request: DELETE /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff HTTP/1.1 Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept: application/json Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Accept-Encoding: identity Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Connection: close Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Length: 0 Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Content-Type: application/json Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Host: 10.222.0.98 Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Openstack-System-Scope: None Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: User-Agent: python-urllib3/1.26.9 Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Auth-Token: gAAAAABi0ZB8ig3-cilnd9jQ8TSt849jlWhSvfUwvMUQotyF5hwBzuNu9hGIi-XItaqQSJamjrznFqzspqIuR0WpAxpLa0HQkZbGeZLc1_zt4I-YzMPHZu8bAngsGZ94x5CWfpp-aTKANUo3V5WaNQJZkUrmA0Os0-SaVVN13rqzQEgNIWJ3hds Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Id: None Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Domain-Name: None Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Identity-Status: Confirmed Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Is-Admin-Project: True Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Id: default Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Domain-Name: Default Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Project-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Role: member,reader Jul 15 16:14:49.166237 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Roles: member,reader Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_801e210cf8c64e7184b178fbde47860c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-Tenant-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Id: default Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Domain-Name: Default Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Id: 14fecc08cd364a48a8640d522577aa39 Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: X-User-Name: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: method: > Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: exception: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.168109 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: action_args: {'id': '418c00e7-672a-4442-95e9-042c560955ff'} Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:14:49.168980 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.170642 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.172397 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Returning 404 to user: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. {{(pid=130091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:14:49.172397 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-de338083-0f03-4db4-87db-4fd0eecce067 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "DELETE /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 404 len: 111 microversion: 2.1 time: 0.029571 Jul 15 16:14:49.172397 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 674/1344] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Jul 15 16:14:49 2022] DELETE /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:14:49.176793 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '>' {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:49.177398 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.compute.api [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] [instance: 418c00e7-672a-4442-95e9-042c560955ff] Fetching instance by UUID {{(pid=130090) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 16:14:49.184041 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:49.184494 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:49.185250 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 16:14:49.185681 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG oslo_concurrency.lockutils [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Lock "7af00cbd-57c5-414c-96c9-6111e9479151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 16:14:49.199458 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.wsgi [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] HTTP exception thrown: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Request method failure captured: Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: request: GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff HTTP/1.1 Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept: application/json Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Accept-Encoding: identity Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Connection: close Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Length: 0 Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Content-Type: application/json Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Host: 10.222.0.98 Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Openstack-System-Scope: None Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: User-Agent: python-urllib3/1.26.9 Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Auth-Token: gAAAAABi0ZB8ig3-cilnd9jQ8TSt849jlWhSvfUwvMUQotyF5hwBzuNu9hGIi-XItaqQSJamjrznFqzspqIuR0WpAxpLa0HQkZbGeZLc1_zt4I-YzMPHZu8bAngsGZ94x5CWfpp-aTKANUo3V5WaNQJZkUrmA0Os0-SaVVN13rqzQEgNIWJ3hds Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Id: None Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Domain-Name: None Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Identity-Status: Confirmed Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Is-Admin-Project: True Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Id: default Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Domain-Name: Default Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Project-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Role: member,reader Jul 15 16:14:49.201007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Roles: member,reader Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_801e210cf8c64e7184b178fbde47860c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/801e210cf8c64e7184b178fbde47860c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}] Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Id: 801e210cf8c64e7184b178fbde47860c Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-Tenant-Name: tempest-TestVolumeBootPattern-280606360 Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Id: default Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Domain-Name: Default Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Id: 14fecc08cd364a48a8640d522577aa39 Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: X-User-Name: tempest-TestVolumeBootPattern-280606360-project Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: method: > Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: exception: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.203123 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: action_args: {'id': '418c00e7-672a-4442-95e9-042c560955ff'} Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: {{(pid=130090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 16:14:49.204195 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. Jul 15 16:14:49.205815 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: ERROR nova.api.openstack.wsgi Jul 15 16:14:49.207260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: DEBUG nova.api.openstack.wsgi [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Returning 404 to user: Instance 418c00e7-672a-4442-95e9-042c560955ff could not be found. {{(pid=130090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 16:14:49.207260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO nova.api.openstack.requestlog [None req-1fd3e8a5-9fb3-4816-abbe-08658b289edd tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff" status: 404 len: 111 microversion: 2.1 time: 0.029714 Jul 15 16:14:49.207260 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: [pid: 130090|app: 0|req: 671/1345] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Jul 15 16:14:49 2022] GET /compute/v2.1/servers/418c00e7-672a-4442-95e9-042c560955ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 16:14:50.676111 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: DEBUG nova.api.openstack.wsgi [None req-e213bfb9-5276-4bf0-a883-b6a4fe7d5ed6 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] Calling method '.version_select at 0x7f510ab2a430>' {{(pid=130091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 16:14:50.751268 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO nova.api.openstack.requestlog [None req-e213bfb9-5276-4bf0-a883-b6a4fe7d5ed6 tempest-TestVolumeBootPattern-280606360 tempest-TestVolumeBootPattern-280606360-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1496139757" status: 202 len: 0 microversion: 2.1 time: 0.078932 Jul 15 16:14:50.751867 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: [pid: 130091|app: 0|req: 675/1346] 10.222.0.98 () {58 vars in 1262 bytes} [Fri Jul 15 16:14:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1496139757 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 16:15:08.524521 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:15:08.525094 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:15:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:15:11.142110 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:15:11.142973 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:16:50.445222 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:16:50.445685 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 16:16:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:17:06.058429 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:17:06.059048 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:17:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:17:29.364027 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:17:29.364688 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 16:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:18:28.532388 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:18:28.532907 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:18:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:18:31.150955 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:18:31.151781 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:18:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:20:10.454342 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:20:10.454882 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 16:20:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:20:10.706343 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:20:10.706577 dv-cinder-835878-3-iscsi devstack@n-api.service[130091]: Fri Jul 15 16:20:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:20:26.067007 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:20:26.067644 dv-cinder-835878-3-iscsi devstack@n-api.service[130090]: Fri Jul 15 16:20:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!